如何从 html 中提取所有文本，不包括 css 和 javascript 在 ZA7F5F35426B9237211FC9231B73 中使用 lxml

Question

How can I extract all text from a html excluding any css and javascript?

I am trying the following code:

r = requests.get(website)
tree = html.fromstring(r.text)
html_text = tree.xpath('//text()')

But it also retrieves all css and javascript content from the website

Answer 1

You can use the drop_tree() method to remove elements that you are not interested in.

tree = html.fromstring(r.text)

unwanted = tree.xpath('//script|//style')
for u in unwanted:
    u.drop_tree()

html_text = tree.xpath('//text()')