[英]Scrape data from website to pandas dataframe
我正在嘗試從會議辦公室的網站上抓取天氣數據,但是我一直遇到錯誤。
到目前為止,這是我嘗試過的
stats = ['Tmax', 'Tmin', 'Rainfall']
regions = ['England', 'Wales', 'Scotland']
base_url = r'https://www.metoffice.gov.uk/pub/data/weather/uk/climate/datasets/{}/date/{}.txt'
dframes = []
for r in regions:
for s in stats:
url = base_url.format(s,r)
df = pd.read_table(requests.get(url).content)
dframes.append(df)
我開始出錯:
"OSError: Expected file path name or file-like object, got <class 'bytes'> type"
您必須通過流使用該字節,例如io.BytesIO
:
import pandas as pd
import requests
import io
stats = ['Tmax', 'Tmin', 'Rainfall']
regions = ['England', 'Wales', 'Scotland']
base_url = r'https://www.metoffice.gov.uk/pub/data/weather/uk/climate/datasets/{}/date/{}.txt'
dframes = []
for r in regions:
for s in stats:
url = base_url.format(s,r)
df = pd.read_table(io.BytesIO(requests.get(url).content))
dframes.append(df)
print(dframes)
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.