如何在 html 源代码中提取 href 属性

Question

This is HTML source code that I am dealing with:

<a href="/people/charles-adams" class="gridlist__link">

So what I want to do is to extract the href attribute, in this case would be "/people/charles-adams", with beautifulsoup module. I need this because I want to get html source code with soup.findAll method for that particular webpage. But I am struggling to extract such attribute from the webpage. Could anyone help me with this problem?

PS I am using this method to get html source code with Python module beautifulSoup:

request = requests.get(link, headers=header)
html = request.text
soup = BeautifulSoup(html, 'html.parser')

Answer 1

Try something like:

refs = soup.find_all('a')
for i in refs:
    if i.has_attr('href'):
        print(i['href'])

It should output:

/people/charles-adams

Answer 2

You can tell beautifulsoup to find all anchor tags with soup.find_all('a') . Then you can filter it with list comprehension and get the links.

request = requests.get(link, headers=header)
html = request.text
soup = BeautifulSoup(html, 'html.parser')

tags = soup.find_all('a')
tags = [tag for tag in tags if tag.has_attr('href')]
links = [tag['href'] for tag in tags]

links will be ['/people/charles-adams']