[英]How to unescape special characters from BeautifulSoup output?
我面临着像°和®这样的特殊字符的问题，这些字符代表了华氏度符号和注册符号，
当我打印包含特殊字符的字符串时，它给出如下输出：
Preheat oven to 350° F
Welcome to Lorem Ipsum Inc®
有没有办法可以输出确切的字符，而不是他们的代码？ 请告诉我。
$ python -c'from BeautifulSoup import BeautifulSoup
> print BeautifulSoup("""<html>Preheat oven to 350° F
> Welcome to Lorem Ipsum Inc®""",
> convertEntities=BeautifulSoup.HTML_ENTITIES).contents[0].string'
Preheat oven to 350° F
Welcome to Lorem Ipsum Inc®
这是一个脚本，用于容忍从网页中取消HTML引用 - 它假设引用是例如在° 格式后用分号（例如Preheat oven to 350° F ）：
from htmlentitydefs import name2codepoint
# Get the whitespace characters
nums_dict = {0: ' ', 1: '\t', 2: '\r', 3: '\n'}
chars_dict = dict((x, y) for y, x in nums_dict.items())
nums_dict2XML = {0: ' ', 1: '	', 2: ' ', 3: ' '}
chars_dict2XML = dict((nums_dict[i], nums_dict2XML[i]) for i in nums_dict2XML)
s = '1234567890ABCDEF'
hex_dict = {}
for i in s:
hex_dict[i.lower()] = None
hex_dict[i.upper()] = None
del s
def is_hex(s):
if not s:
return False
for i in s:
if i not in hex_dict:
return False
return True
class Unescape:
def __init__(self, s, ignore_whitespace=False):
# Converts HTML character references into a unicode string to allow manipulation
self.s = s
self.ignore_whitespace = ignore_whitespace
self.lst = self.process(ignore_whitespace)
def process(self, ignore_whitespace):
def get_char(c):
if ignore_whitespace:
return c
else:
if c in chars_dict:
return chars_dict[c]
else: return c
r = []
lst = self.s.split('&')
xx = 0
yy = 0
for item in lst:
if xx:
split = item.split(';')
if split[0].lower() in name2codepoint:
# A character reference, e.g. '&'
a = unichr(name2codepoint[split[0].lower()])
r.append(get_char(a)) # TOKEN CHECK?
r.append(';'.join(split[1:]))
elif split[0] and split[0][0] == '#' and split[0][1:].isdigit():
# A character number e.g. '4'
a = unichr(int(split[0][1:]))
r.append(get_char(a))
r.append(';'.join(split[1:]))
elif split[0] and split[0][0] == '#' and split[0][1:2].lower() == 'x' and is_hex(split[0][2:]):
# A hexadecimal encoded character
a = unichr(int(split[0][2:].lower(), 16)) # Hex -> base 16
r.append(get_char(a))
r.append(';'.join(split[1:]))
else:
r.append('&%s' % ';'.join(split))
else:
r.append(item)
xx += 1
yy += len(r[-1])
return r
def get_value(self):
# Convert back into HTML, preserving
# whitespace if self.ignore_whitespace is `False`
r = []
for i in self.lst:
if type(i) == int:
r.append(nums_dict2XML[i])
else:
r.append(i)
return ''.join(r)
def unescape(s):
# Get the string value from escaped HTML `s`, ignoring
# explicit whitespace like tabs/spaces etc
inst = Unescape(s, ignore_whitespace=True)
return ''.join(inst.lst)
if __name__ == '__main__':
print unescape('Preheat oven to 350° F')
print unescape('Welcome to Lorem Ipsum Inc®')
编辑：这是一个更简单的解决方案，只用字符替换字符引用而不是&#xx; 引用：
from htmlentitydefs import name2codepoint
def unescape(s):
for name in name2codepoint:
s = s.replace('&%s;' % name, unichr(name2codepoint[name]))
return s
print unescape('Preheat oven to 350° F')
print unescape('Welcome to Lorem Ipsum Inc®')
在美丽的汤4：
my_text = """Preheat oven to 350° F
Welcome to Lorem Ipsum Inc® """
soup = BeautifulSoup(my_text, 'html.parser')
print(soup)
结果：
Preheat oven to 350° F
Welcome to Lorem Ipsum Inc®
我想某个地方，一个程序引用了＆deg和＆reg而没有分号。 尝试使用“＆deg”+“;” 和“＆reg”+“;” 在HTML文件中，如果它确实是HTML文件。 请解释一下背景。
如何在将pyquery对象转换为字符串时取消特殊字符
[英]How to unescape special characters while converting pyquery object to string
如何使用beautifulsoup从网页中正确提取特殊字符？
[英]How to correctly extract special characters from a webpage using beautifulsoup?
如果未在字典中声明字符，如何从用户输入中输出特殊字符
[英]How to output the special characters from user input if character is not declared on the dictionary
我需要从BeautifulSoup的字符串输出中删除多余的字符
[英]I need to remove excess characters from string output of BeautifulSoup
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.