在我的烧瓶应用程序中使用“ BOTO”的Amazon S3文件上传问题-Python

Question

In my flask application, I am using a function to upload file to Amazon s3, using Boto.

Its working fine most of the cases, but some times its uploading files as zero byte file with no extension.

Why its failing sometimes,

I am validating user image file in form.

FileField('Your photo',validators=[FileAllowed(['jpg', 'png'], 'Images only!')])

My image upload function.

def upload_image_to_s3(image_from_form):


    #upload  pic to amazon
    source_file_name_photo = secure_filename(image_from_form.filename)
    source_extension = os.path.splitext(source_file_name_photo)[1]
    destination_file_name_photo = uuid4().hex + source_extension


    s3_file_name = destination_file_name_photo

    # Connect to S3 and upload file.

    conn = boto.connect_s3('ASJHjgjkhSDJJHKJKLSDH','GKLJHASDJGFAKSJDGJHASDKJKJHbbvhjcKJHSD')
    b = conn.get_bucket('mybucket')

    # Connect to S3 and upload file.

    sml = b.new_key("/".join(["myfolder",destination_file_name_photo]))
    sml.set_contents_from_string(image_from_form.read())
    acl='public-read'
    sml.set_acl(acl)

    return s3_file_name

Answer 1

How large are your assets? If there is too large of an upload, you may have to multipart/chunk it otherwise it will timeout.

bucketObject.initiate_multipart_upload('/local/object/as/file.ext')

it means you will not be using set_contents_from_string but rather store and upload. You may have to use something to chuck the file, like FileChuckIO.

An example is here if this applies to you : http://www.bogotobogo.com/DevOps/AWS/aws_S3_uploading_large_file.php

Also, you may want to edit your post above and alter your AWS keys.