多个 object 通过在 s3 中仅打开一次 json 从 json 文件中删除

Question

I have few json files in s3, now want to delete some objects from that json file by opening the file for one time and delete those objects at a time and also chaeck if the objects are present in the json file or not. and lastly want to update the file in the same location in s3.

img_list is the list of objects to be deleted.

img_list = ['0000002.jpg','0000003.jpg','0000006.jpg']

edit_jsons_path = 'path where the json is located in s3'

# Contents like this:
# {
#     "abc": {
#         "0000001.jpg": {
#         },
#         "0000002.jpg": {
#         },
#         "0000003.jpg": {
#         },
#         "0000004.jpg": {
#         }
#     },
#     "xyz": {
#         "xx": 467,
#         "yy": 4
#     }
# }

s3 = boto3.client('s3')
   
def json_edit(img_list,edit_jsons_path):
    response = s3.get_object(Bucket = bucket, Key = edit_jsons_path)
    json_content = response["Body"].read().decode("utf-8")
    data = json.loads(json_content)
    
    for obj in img_list:
        del data['abc'][obj]

    s3.put_object(Bucket = bucket, Key = edit_jsons_path, Body = json.dumps(data))

Expected output:

{
    "abc": {
        "0000001.jpg": {
        },
        "0000004.jpg": {
        }
    },
    "xyz": {
        "xx": 467,
        "yy": 4
    }
}

Answer 1

S3 is object/blob storage. There isn't a way to "edit" an S3 file like a traditional file on your local file system. You will need to read the file, make the edits you desire, and push the update over the top of the existing file.