如何将S3数据上移到一个分区级别？

Question

Let's say I have a table in the path

s3:bucketname/tablename/month/day/deviceid

I want to move all files to s3:bucketname/tablename/month/day/ . In other words, I want to ignore the last partition.

Note that there are already data in the path s3:bucketname/tablename/month/day/

Can I use aws s3 to achieve this?

I have more than 100K files so I cannot do this manually.

Answer 1

I believe you can use the AWS console on the web . Open the source folder ( deviceid ), select all its contents by the checkbox to the left on Name.

Then select Actions → Copy.

Open the destination folder ( day ), click Actions → Paste. Confirm the operation.

Once the operation has finished successfully, you can delete the source folder with all its contents.

Answer 2

You can do this in 2 ways.

If you are not familiar with the aws cli, then go to the console, select all the files, cut and paste on the desired directory. However, this is very time consuming and inefficient task.

I recommend the aws cli for S3. You can find some sample commands here .