Python精美湯解析每個Div中的第一個Href

Question

給出以下代碼：

# import the module
import bs4 as bs
import urllib.request
import re

masterURL = 'http://www.metrolyrics.com/top100.html'
sauce = urllib.request.urlopen(masterURL).read()
soup = bs.BeautifulSoup(sauce,'lxml')




for div in soup.findAll('ul', {'class': 'song-list'}):
    for span in div:
        for link in span:
            for a in link:
                print(a)

我可以解析多個div，結果如下：

我的問題是，沒有獲得div的全部內容，我如何只返回突出顯示的部分Href的URL？

Answer 1

嘗試這個。 您需要指定正確的class來獲取連接到它的URL。

from bs4 import BeautifulSoup
import urllib.request

masterURL = 'http://www.metrolyrics.com/top100.html'
sauce = urllib.request.urlopen(masterURL).read()
soup = BeautifulSoup(sauce,'lxml')

for div in soup.find_all(class_='subtitle'):
    print(div.get("href"))

輸出：

http://www.metrolyrics.com/charles-goose-lyrics.html
http://www.metrolyrics.com/param-singh-lyrics.html
http://www.metrolyrics.com/westlife-lyrics.html
http://www.metrolyrics.com/luis-fonsi-lyrics.html
http://www.metrolyrics.com/grease-lyrics.html
http://www.metrolyrics.com/shanti-dope-lyrics.html

等等 - -

Answer 2

if 'href' in a.attrs:
     a.attrs['href']

這將為您提供所需的東西。