[英]How to download files directly into an archive?
I want to download multiple files and save them in a zipfile.我想下载多个文件并将它们保存在一个 zip 文件中。
Here is my code so far:到目前为止,这是我的代码:
import zipfile
import requests
import os
pics = ['url/1.jpg', 'url/2.jpg', 'url/3.jpg']
dir = '/directory'
with zipfile.ZipFile(dir + '/test.zip', 'w') as my_zip:
for x in range(len(pics)):
fn = dir + '/' + pics[x].split('/')[-1]
r = requests.get(pics[x], allow_redirects=True)
open(fn, 'wb').write(r.content)
my_zip.write(fn, str(x+1) + os.path.splitext(fn)[1])
os.remove(fn)
Is there a smarter/cleaner/shorter way to do this.有没有更聪明/更清洁/更短的方法来做到这一点。 Downloading the img, then putting it into the zip and then deleting it seems unnecessarily complicated.
下载 img,然后将其放入 zip,然后删除它似乎不必要地复杂。
I think you should you a temporary file in such cases.我认为在这种情况下你应该给你一个临时文件。
This should work:这应该工作:
import requests
import zipfile
import tempfile
pics = ['http://www.princeton.edu/~dancexp/Images/1-XPAlifun.jpg',
'http://www.princeton.edu/~dancexp/Images/1-ExposeJess.jpg',
'http://www.princeton.edu/~dancexp/Images/JessHsurevisedlores.jpg']
picdirname = "mypics"
with zipfile.ZipFile("test.zip", "w") as my_zip:
for pic in pics:
response = requests.get(pic)
if response.status_code == 200:
tmpf = tempfile.TemporaryFile()
tmpf.write(response.content)
tmpf.seek(0)
my_zip.writestr(pic.split('/')[-1], tmpf.read())
tmpf.close()
I think speed is also important.我认为速度也很重要。 Try this code
试试这个代码
import requests, zipfile, os
from multiprocessing.dummy import Pool
directory = 'pics/'
def Save(url):
filename = directory+url.split('/')[-1]
try:
try:
res = requests.get(url)
open(filename, 'wb').write(res.content)
except:
return {'filename': filename, 'status': 'cant crate file.'}
except:
return {'filename': filename, 'status': 'error'}
else:
return {'filename': filename, 'status': 'ok'}
urls = ['https://i.stack.imgur.com/kBVja.jpg',
'https://lh5.googleusercontent.com/-TlrV5ArUF6s/AAAAAAAAAAI/AAAAAAAAAC0/d605oPHpYgc/photo.jpg',
'https://i.stack.imgur.com/ipDCR.png',
'https://i.stack.imgur.com/Zpq5l.jpg']
pool_ = Pool(16) #It depends on your processor and the Internet to increase or decrease it
result = pool_.map(Save, urls)
with zipfile.ZipFile('test.zip', 'w') as zip_file:
for x in result:
if x['status'] == 'ok':
zip_file.write(x['filename'])
os.remove(x['filename'])
print(x['filename'], " + Added to zip file")
else:
print(x)
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.