[英]Getting a TypeError: list indices must be integers or slices, not str
[英]Crawling IDs and getting TypeError: list indices must be integers or slices, not str
我嘗試從房地產網站獲取ID。 在我的第一次嘗試中,我總是獲得一個建築項目中的第一個房地產。 現在,我嘗試進一步深入HTML樹,以獲取其余的建築項目。 但是我得到這個錯誤:
“ TypeError:列表索引必須是整數或切片,而不是str”
HTML看起來像這樣:
"resultlist.resultlist": { "paging": { "next": { "@xlink.href": "\\/Suche\\/ST\\/P-2\\/Wohnung-Kauf\\/Nordrhein-Westfalen\\/Duesseldorf\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/true" }, "current": { "@xlink.href": "\\/Suche\\/ST\\/Wohnung-Kauf\\/Nordrhein-Westfalen\\/Duesseldorf\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/-\\/true" }, "pageNumber": 1, "pageSize": 20, "numberOfPages": 3, "numberOfHits": 140, "numberOfListings": 50 }, "matchCountList": "", "resultlistEntries": [{ "@numberOfHits": "140", "@realEstateType": "2", "resultlistEntry": [{ "@id": "111337199", "@modification": "2019-06-09T13:36:23.513+02:00", "@creation": "2019-05-05T14:10:47.000+02:00", "@publishDate": "2019-05-05T14:10:47.000+02:00", "similarObjects": [{ "similarObject": [{ "@id": "105147583", "@modification": "2019-05-05T10:37:59.830+02:00", "@creation": "2018-05-30T11:44:29.000+02:00", "@publishDate": "2018-05-30T11:44:29.000+02:00", "realEstateId": 105147583,
我的第一次嘗試是這樣的:
page1 = ('https://www.immobilienscout24.de/Suche/S-1/Wohnung-Kauf/Nordrhein-Westfalen/Duesseldorf/-/-/-/-/-/-/-/-/-/-/-/-/-/-/-/-/-/true')
res_page1 = requests.get(page1)
soup_page1 = bs(res_page1.content, 'lxml')
r_page1 = re.compile(r'resultListModel:(.*)')
data_page1 = soup_page1.find('script', text=r_page1).text
script_page1 = r_page1.findall(data_page1)[0].rstrip(',')
results_page1 = json.loads(script_page1)
ids_page1 = [item["@id"] for item in results_page1['searchResponseModel']['resultlist.resultlist']['resultlistEntries'][0]['resultlistEntry']]
並得到以下輸出:
['111353960', '110253440', '111994208', '110517626', '109984070', '109855231', '108761945', '108639776', '106997219', '106492496', '111604737', '111357085', '92741038', '112031279', '111988597', '111876292', '111870285', '111798416', '110742328', '110742299']
現在我去得到其余的像這樣:
ids_page1 = [item["@id"] for item in results_page1['searchResponseModel']['resultlist.resultlist']['resultlistEntries']['resultlistEntry']['similarObjects'][0]['similarObject']]
現在,我收到類型錯誤。
有人可以解釋一下我在做什么錯。
嘗試以下通過級別的內容
from bs4 import BeautifulSoup as bs #4.7.1
import requests
page1 = 'https://www.immobilienscout24.de/Suche/S-1/Wohnung-Kauf/Nordrhein-Westfalen/Duesseldorf/-/-/-/-/-/-/-/-/-/-/-/-/-/-/-/-/-/true'
res_page1 = requests.get(page1)
soup_page1 = bs(res_page1.content, 'lxml')
r_page1 = re.compile(r'resultListModel:(.*)')
data_page1 = soup_page1.find('script', text=r_page1).text
script_page1 = r_page1.findall(data_page1)[0].rstrip(',')
results_page1 = json.loads(script_page1)
ids = []
for item in results_page1['searchResponseModel']['resultlist.resultlist']['resultlistEntries'][0]['resultlistEntry']:
ids.append(item['@id'])
if 'similarObjects' in item:
for i in item['similarObjects'][0]['similarObject']:
if isinstance(i,dict):
ids.append(i['@id'])
elif i == '@id':
ids.append(item['similarObjects'][0]['similarObject'][i])
在輸出中,您將看到一個字符串列表。 注意值周圍的'
。 在數字串上調用int(s)
將其轉換為數字。
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.