不能使用 findAll() 函数

Question

can any body tell me why is error

html_content = get_html_content(test)
    from bs4 import BeautifulSoup
    soup = BeautifulSoup(html_content, 'html.parser')
    productDetail = []
    product = soup.findAll("div",{"class":"s-result-item"})
    for pd in product:
        product = pd.find("div",class_="s-impression-counter")
        product_name = product.find('span',class_="a-text-normal").text
        productDetail.append(product_name)
        print(productDetail)

it appears 'NoneType' object has no attribute 'find'

i know the problem is in the product variable, but if i not allow to use findAll() , what should i use ?

Answer 1

You are assigning the product variable in your for loop directly after its assignment.

On a side note, you should be using the updated find_all() method - this is exactly the same but it conforms to the Python style guide .

Try this instead: -

from bs4 import BeautifulSoup

html_content = get_html_content(test)
soup = BeautifulSoup(html_content, 'html.parser')
productDetail = []
all_products = soup.find_all("div",{"class":"s-result-item"})

for pd in all_products:
    product = pd.find("div",class_="s-impression-counter")
    product_name = product.find('span',class_="a-text-normal").text 
    productDetail.append(product_name)
    print(productDetail)

Note I have changed your original product variable to all_products to ensure there is a distinction between the variables.