通过 Python BeautifulSoup 中的特定文本查找标签

Question

Do you know how to search for specific text inside pythons BeautifulSoup, to find tags - better full path to tags, containing some string? The common way of BS usage is for example:

import requests
from bs4 import BeautifulSoup

url = "https://elementy.ru/novosti_nauki"


website = requests.get(url)
results = BeautifulSoup(website.content, 'html.parser')

and then you can quueuery for all tags with some properties, like header, class, etc. However i want to go different way, and find the location of the specific text inside this structure? If you do it with plain HTML text it is really unconvenient. Any ideas how to do this with BS? Thanks

Answer 1

You could use a css selector :

soup.select(':-soup-contains("that")')

or as alternative re.compile() :

import re
soup('p', text=re.compile('that')))

Example

from bs4 import BeautifulSoup

html = '''
<p>some content</p>
<p>pattern that we like</p>
<p>some content</p>
'''
soup = BeautifulSoup(html, 'html.parser')

soup.select(':-soup-contains("that")')

Output

[<p>pattern that we like</p>]