How do I get certain links from a website, but not all of them?

Question

Here's what I have so far:

import requests
from bs4 import BeautifulSoup

def linkScraper():
    html = requests.get("https://www.bbc.com/").text
    soup = BeautifulSoup(html, 'html.parser')
    
    for link in soup.find_all('a'):
        print(link.get('href'))

But this prints every single link on the website. How can I configure this to give me the links to the articles that appear on the BBC's homepage?

Answer 1

您可以使用列表理解对其进行过滤：

links = [link for link in soup.find_all('a') if link.startswith('https://www.bbc.com/')]