美汤中还有续function吗？

Question

from unittest import skip
import requests
from bs4 import BeautifulSoup
from csv import writer
import openpyxl

wb = openpyxl.load_workbook('Book3.xlsx')
ws = wb.active

with open('mtbs.csv', 'w', encoding='utf8', newline='') as f_output:
    csv_output = writer(f_output)
    header = ['Code','Product Description']
    csv_output.writerow(header)
    
    for row in ws.iter_rows(min_row=1, min_col=1, max_col=1, values_only=True):
        url = f"https://www.radwell.com/en-US/Buy/MITSUBISHI/MITSUBISHI/{row[0]}"
        print(url)
        req_page = requests.get(url)
        soup = BeautifulSoup(req_page.content, 'html.parser')
        div_techspec = soup.find('div', class_="minitabSection")

        if 'minitabSection' not in url:
            continue //does not work

        code = div_techspec.find_all('li')
        description1 = div_techspec.find_all('li')
        description2 = div_techspec.find_all('li')
        description3 = div_techspec.find_all('li')


        info = [code[0].text, description1[1].text, description2[2].text, description3[3].text]
        csv_output.writerow(info)

我目前正在尝试从某个网站收集数据。 我有一张包含数百个产品代码的 excel 表。 但是，我目前正在从中报废的网站中不存在某些产品，并且循环停止运行。

if 'minitabSection' not in url: continue

应该跳过不存在的URL，继续运行代码的rest。 我如何实现这一目标？

Answer 1

不确定 url 中是否有字符串minitabSection - 当您尝试find() div_techspec时，您应该检查其结果：

...
div_techspec = soup.find('div', class_="minitabSection")

if div_techspec is None:
    continue 
...

或其他方式：

...
div_techspec = soup.find('div', class_="minitabSection")

if div_techspec:
    code = div_techspec.find_all('li')

    info = [code[0].text, code[1].text, code[2].text, code[3].text]
    csv_output.writerow(info)

else:
    continue 
...