Scrapy。 如何从已解析的HTML中的标记中删除样式属性（类或id属性）

Question

Scrapy. How to remove style attributes (class or id attributes) from tags in parsed HTML with lxml help? Something like lxml.html.clean.Cleaner or something like:

for tag in html.xpath('//*[@class]'):
    tag.attrib.pop('class')

Answer 1

You have to import another builtin python class in the spider file

import lxml.html.clean as clean
safe_attrs = set(['src', 'alt', 'href', 'title', 'width', 'height'])
kill_tags = ['object', 'iframe']
cleaner = clean.Cleaner(safe_attrs_only=True, safe_attrs=safe_attrs, kill_tags=kill_tags)
html_string = "some html string with iframes, objects…"

and then use it like this

cleaned_html = cleaner.clean_html(html_string)

You can customize safe_attrs , and kill_tags to whatever attr and tags you want to remove.