[英]How to get raw response stream using aiohttp?
我需要获取原始(压缩)内容。 我的目标是将其原样保存到S3。 处理requests
很容易:
import requests
response = requests.get('http://google.com', stream=True)
content = response.raw.read() # b'\x1f\x8b\x08\x00\x00\x00\x00...'
但是,使用aiohttp
我总是可以获得未压缩的内容:
import asyncio
import aiohttp
async def download(url):
async with aiohttp.ClientSession() as session:
async with session.get(url) as response:
content = await response.content.read() # b'<!doctype html><html...'
if __name__ == '__main__':
loop = asyncio.get_event_loop()
loop.run_until_complete(download('http://google.com'))
class aiohttp.ClientSession(
*,
connector=None,
loop=None,
cookies=None,
headers=None,
skip_auto_headers=None,
auth=None,
json_serialize=json.dumps,
version=aiohttp.HttpVersion11,
cookie_jar=None,
read_timeout=None,
conn_timeout=None,
timeout=sentinel,
raise_for_status=False,
connector_owner=True,
auto_decompress=True,
proxies=None
)
尝试设置auto_decompress = false 文档
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.