如何使用 lambda python 创建 zip 文件并上传回 s3？

Question

Hope everybody is safe and happy.

I have given a AWS task as follow.

Requirement: As soon as file gets uploaded in s3 bucket,it should be zipped and must be uploaded back to another s3 bucket.

I am able to complete this task using lambda(python) but it involves lots of disk IO. So ,i am looking for a solution where i will not require to store incoming s3 object at /tmp/ folder. As we all know , lambda provides very less memory and storage(500MB). Hence, wants to avoid this approach.

So, does anybody aware of how to zip the incoming s3 file on the fly? I am only aware that, it possible to do with the help of streaming of s3 object. But not able to find how it can be achieved end to end using python language.

Thanks in advance.

Answer 1

您可以在 Lambda 中使用 python 生成器来压缩 s3 文件并将 zip 文件放回另一个 s3 中，因为生成器不占用内存。