多文件到AWS S3存储桶

Question

Im trying to understand few things. I just want to know whether mfs/multifile(file data is split and kept in different servers) files in abinito can be pushed to aws s3 bucket directly? . As of now we are converting mfs/multifile file to serial and then pushing it to the aws s3 bucket.

I did some research on this and came across an term called multi part upload api in aws. I went through the aws support docs and understood the concept of it. My doubt s whether it can be used to push the multi files to aws s3 bucket?.

Thanks! :-) appreciate your valuable response :-)

Answer 1

Disclaimer: I work for Minio .

---

You can alternatively use Minio client aka mc , its open source and compatible with AWS S3 API. Minio client handles multipart mechanism for you natively. Please check docs for deployment and examples.

Hope it helps.