CSS 子选择器（无法选择所有子项）

Question

This is the image of what I'm trying to scrape using beautiful soup. But whenever I use the code shown below, I only get access to the first child. I am never able to get access to all the children. Can someone help me with this?

item = soup.select("ul.items > li")
print(len(item))

Answer 1

The problem can be fixed in 2 steps as follows:

1. Use select_one on soup to get the ul
2. Use find_all on ul to fetch all the li items.

Working solution:

# File name: soup-demo.py

inputHTML = """
<ul class="items">
<li class="class1">item 1</li>
<li class="class1">item 3</li>
<li class="class1">item 3</li>
</ul>
"""
from bs4 import BeautifulSoup
soup = BeautifulSoup(inputHTML, 'html.parser')
itemList = soup.select_one("ul", class_="items")

items = itemList.find_all("li")
print("Found ", len(items), " items")
for item in items:
    print(item)

Output:

$ python3 soup-demo.py 
Found  3  items
<li class="class1">item 1</li>
<li class="class1">item 3</li>
<li class="class1">item 3</li>

Answer 2

Maybe your version is wrong. This is OK.

from bs4 import BeautifulSoup
html = '''
<ul class="items">
  <li>1</li>
  <li>2</li>
</ul>
'''
soup = BeautifulSoup(html,features="lxml")
item = soup.select('ul.items>li')
print (len(item))

There's another solution here

from simplified_scrapy.simplified_doc import SimplifiedDoc
html = '''
<ul class="items">
  <li>1</li>
  <li>2</li>
</ul>
'''
doc = SimplifiedDoc(html)
item = doc.selects('ul.items>li')
print(len(item))

Here are more examples here