如何下载 S3 存储桶中的文件

Question

How to copy all files that start with a prefix. I have a lot of files with the name 2021 - ** - **. You need to download them for a certain period. This commands did not help

aws s3 sync s3://my-bucket/2021-04-12-* .
aws s3 cp s3://my-bucket/2021-04-12-* .

Answer 1

Use python3 script

import boto3
import os

s3 = boto3.resource('s3')
my_bucket = s3.Bucket('my-bucket')

for my_bucket_object in my_bucket.objects.all():
    # Assume your bucket structure as s3://my-bucket/<files> 
    if my_bucket_object.key.startswith('2021-04-12-'):
        os.system(f'aws s3 cp s3://my-bucket/{my_bucket_object.key} .')