如何使用 python 从 html 中删除标签

Question

I have html code like this:

<div class="qtext">A financial model should be developed when the business planning process has reached the _______ planning stage</div>
<div class="rightanswer">The correct answer is: Operational</div>
<div class="qtext">Selling new products to existing customers is a strategy of</div>
<div class="rightanswer">The correct answer is: Product development</div>
<div class="qtext">In the strategic review and strategic planning process Product/Portfolio Analysis follows immediately after the</div>
<div class="rightanswer">The correct answer is: Industry and competitor analysis</div>

I tried removing div tags with this function:

def cleanhtml(raw_html):
    cleanr = re.compile('<.*?>')
    cleantext = re.sub(cleanr, '', raw_html)
    print(cleantext)

and with this code:

cleantext = BeautifulSoup(raw_html, "html.parser").text

But the program returns:

caused error "expected string or bytes-like object"

Then how to remove the div tags? I want the text in the format:

A financial model should be developed when the business planning process has reached the _______ planning stage
The correct answer is: Operational

Type of my raw_html is:

<class 'bs4.element.ResultSet'>

Answer 1

To get text from <div> tags, use .text or .get_text() . For example:

from bs4 import BeautifulSoup

html_doc = """
<div class="qtext">A financial model should be developed when the business planning process has reached the _______ planning stage</div>
<div class="rightanswer">The correct answer is: Operational</div>
<div class="qtext">Selling new products to existing customers is a strategy of</div>
<div class="rightanswer">The correct answer is: Product development</div>
<div class="qtext">In the strategic review and strategic planning process Product/Portfolio Analysis follows immediately after the</div>
<div class="rightanswer">The correct answer is: Industry and competitor analysis</div>
"""

soup = BeautifulSoup(html_doc, "html.parser")
raw_html = soup.select("div.qtext, div.rightanswer")  # <-- raw_html is ResultSet

s = "\n".join(div.get_text(strip=True) for div in raw_html)
print(s)

Prints:

A financial model should be developed when the business planning process has reached the _______ planning stage
The correct answer is: Operational
Selling new products to existing customers is a strategy of
The correct answer is: Product development
In the strategic review and strategic planning process Product/Portfolio Analysis follows immediately after the
The correct answer is: Industry and competitor analysis