繁体   English   中英

Web 刮过多个页面并没有保存每个结果-beautifulsoup

[英]Web scraping through multiple pages doesnt save each result -beautifulsoup

我的问题是,它遍历页面,但它没有在我的列表中写入任何内容。

最后我打印len(title) ,它仍然是 0。

from bs4 import BeautifulSoup
import requests

for page in range(20, 200, 20):
    current_page = 'https://auto.bazos.sk/{}/?hledat=kolesa&hlokalita=&humkreis=&cen'.format(page)
    web_req = requests.get(current_page).text
    soup = BeautifulSoup(requests.get(current_page).content, 'html.parser')

    title_data = soup.select('.nadpis')
    title = []
    for each_title in title_data:
        title.append(each_title.text)
    print(current_page)

print(len(title))

title移出loop ,就可以了。

import requests
from bs4 import BeautifulSoup

title = []
for page in range(20, 40, 20):
    current_page = 'https://auto.bazos.sk/{}/?hledat=kolesa&hlokalita=&humkreis=&cen'.format(page)
    soup = BeautifulSoup(requests.get(current_page).content, 'html.parser')
    title_data = soup.select('.nadpis')
    for each_title in title_data:
        title.append(each_title.text)
    print(current_page)
print(title)

Output:

['ELEKTRONY SKODA OCTAVIA SCOUT DISKY “PROTEUS” R17', 'Fiat Sedici 1.6, 4x4, r.v 04/2009, 79 kw, slovenské ŠPZ', 'Bmw e46 328ci', '255/50 R19', 'Honda Jazz 1.3', 'Predám 4 ks kolesá', 'Audi A5 3.2 FSI quattro tiptronic  S LINE R20  TOP STAV', 'Peugeot 407 combi 1,6 hdi', 'Škoda Superb 2.0TDI 4x4 od 260€ mesačne, bez akontácia', 'Predam elektrony Audi 5x112 R17 a letne pneu', 'ROZPREDÁM MAZDA 3 2.0i 110kW NA NÁHRADNÉ DIELY', 'Predám Astra j Turbo Noblesse bronz', 'ŠKODA KAROQ  1.6 TDI - full výbava', 'VW CHICAGO 5x112 + letné pneu 215/40 R18', 'Fiat 500 SPORT 1.3 multijet 70kw', 'Volvo FL280 - TROJSTRANNÝ SKLÁPAČ + HYDRAULICKÁ RUKA', 'ŠKODA SUPERB COMBI 2.0 TDI 190K 4X4 L&K DSG', 'FORD FOCUS 2.0 TDCI TITANIUM', 'FORD EDGE 2.0 TDCi - 154 kW  VIGNALE : 27.000 km', 'R18 5x112 originalne Vw Seat Audi Skoda']

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM