I am uploading some files to an s3 bucket using Java. The size of each file is very less (~ 2KB). However the number of files is very large (~ 1 Mil). Due to this the upload takes a lot of time, around 2-3 hours. Is there anyway to reduce the upload time? I use the putObject
method for each file.
There are no methods in AWS directly to run your workloads in parallel. Instead take a look at Java multithreading and process your upload function concurrently: Multithreading in java with examples
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.