Python使用BeautifulSoup解析HTML

Question

我正试图从这个[网页] [1]中获取特定数据并最终想把它放到我自己的表中，除了现在，我只是希望能够得到我想要显示的数据。 通过下面的代码，我可以让所有带有班级团队的团队出现，但是我想要让'团队奇怪'和'团队甚至'出现，最好先让团队奇怪出现然后团队出现。

我现在只专注于取名。 任何帮助将不胜感激我一直想弄清楚这一天，并且相当破解它！ 我刚开始学习python而且不​​想让你给我答案，只是指出我正确的方向。

谢谢！

import bs4, requests
from bs4 import BeautifulSoup
# Scraping all data from website

url = 'http://www.scoresandodds.com/index.html'
response = requests.get(url)
html = response.content
# Taking content from above and searching through it find certain elements with certain attributes

soup = BeautifulSoup(html, "html.parser")
table = soup.find('tbody')

for row in table.findAll('tr', attrs={'class' : 'team even'}):
    list_of_cells = []
    for cell in row.findAll('td'):
        text=cell.text.replace(' ', '')
        list_of_cells.append(text)
    print(list_of_cells)

Answer 1

要获得名称很简单，请使用class_="game"这样你就可以得到奇数，甚至只需用文本名称拉取td：

from bs4 import BeautifulSoup
import requests

soup = BeautifulSoup(requests.get("http://www.scoresandodds.com/index.html").content)

table = soup.select_one("#mlb").find_next("table")

head = ",".join([th.text for th in table.select("tr th")])
print(head)
for tr in table.find_all("tr",class_="team"):
     print(tr.find("td","name").text.strip())

哪个会给你：

951 SAN FRANCISCO GIANTS
952 PITTSBURGH  PIRATES
953 SAN DIEGO PADRES
954 CINCINNATI REDS
955 CHICAGO CUBS
956 MIAMI MARLINS
957 NEW YORK METS
958 ATLANTA BRAVES
959 ARIZONA DIAMONDBACKS
960 COLORADO ROCKIES
961 SEATTLE MARINERS
962 DETROIT TIGERS
963 CHICAGO WHITE SOX
964 BOSTON RED SOX
965 OAKLAND ATHLETICS
966 LOS ANGELES ANGELS
967 PHILADELPHIA PHILLIES
968 MINNESOTA TWINS

要获取多个数据，您可以传递一个类列表：

from bs4 import BeautifulSoup
import requests

soup = BeautifulSoup(requests.get("http://www.scoresandodds.com/index.html").content)

table = soup.select_one("#mlb").find_next("table")

head = ",".join([th.text for th in table.select("tr th")])
print(head)
for tr in table.find_all("tr",class_="team"):
    print(", ".join([td.text.strip() for td in tr.find_all("td",["name","pitcher","currentline","score"]) ]))

如果我们查看源代码，您会看到一些类名称像行一样重复：

所以我们也可以使用id来获取当前和运行线等...使用部分id文本的数据：

for tr in table.find_all("tr", class_="team"):
    print(tr.select_one("td[id*=Pitcher]").text)
    print(tr.select_one("td[id*=Current]").text)
    print(tr.select_one("td[id*=Line]").text)
    print("")

谁会给你：

(r) surez, a
8.5o15
+1.5(-207)

(l) niese, j
-108
-1.5(+190)

(l) friedrich, c
9.5o15
+1.5(-195)

(l) lamb, j
-115
-1.5(+179)

(l) lester, j
-156
-1.5(-105)

(l) chen, w
7.5o15
+1.5(-103)

(r) harvey, m
-155
-1.5(+106)

(r) wisler, m
7.5u15
+1.5(-115)

(r) greinke, z
-150
-1.5(+109)

(r) butler, e
10.5
+1.5(-118)

(r) sampson, a
10u15
+1.5(-170)

(l) norris, d
-123
-1.5(+156)

(r) shields, j
10o20
+1.5(+117)

(r) porcello, r
-235
-1.5(-127)

(r) graveman, k
8o15
+1.5(-170)

(r) lincecum, t
-133
-1.5(+156)

(r) eickhoff, j
8.5
+1.5(-154)

(r) nolasco, r
-151
-1.5(+142)

您应该能够将它们拼凑在一起以获得所需的所有表格数据。