如何使用 AWS 网关和 S3 代理上传大文件

Question

I have AWS Gateway API configured as proxy for S3 to upload a file to S3 bucket. I have configured binary media to support multipart/form-data

I am able to upload a file of size 10MB or less without any issue. However when the file size is more than 10MB i get 413 Request Entity Too Large issue.

I know that AAG has hard limit of 10 MB on payload.

Questions
1>Isn't adding multipart/form-data should solve the 10 MB limit issue? Do i need to configure anything else?

2>Another approach recommended is to create pre-signed url . I am assuming for this approach to work client has to make call to get pre-signed url and then use that url to upload a file. Is this the only approach to upload a large file?

Note that I have gone through several SO post regarding the same issue, but most of them are old and i am curious to see if there are any new recommendations.

Answer 1

The 10 MB payload limit is hard and cannot be increased [ 1 ].

It seems to be possible to split the file into chunks on the client and then put it together on the server again [ 2 ] to circumvent the 10 MB limit, but I do not think this is a reasonable approach. The pre-signed URL approach seems better to me, if you do not use a client SDK which provides functionality for chunking.

Please note that if you ever decide to move away from S3, you can still implement the very same interface on any server yourself. In my opinion it is therefore the way to go.