[英]read bytes string from file in python3
The content of a file is like following, and the file encoding is utf-8:文件内容如下,文件编码为utf-8:
cd232704-a46f-3d9d-97f6-67edb897d65f b'this Friday, Gerda Scheuers will be excited \xe2\x80\x94 but she\xe2\x80\x99s most excited about the merchandise the movie will bring.'
Here is my code:这是我的代码:
with open(file, 'r') as f_in:
for line in f_in:
tokens = line.split('\t')
print(tokens[1])
I want to get the right answer - "this Friday, Gerda Scheuers will be excited - but she's most excited about the merchandise the movie will bring."我想得到正确的答案——“这个星期五,Gerda Scheuers 会很兴奋——但她最兴奋的是这部电影将带来的商品。”
print(b'\xe2\x80\x94'.decode('utf-8')) #convert into ASCII
But I can't read the bytes from a file.但我无法从文件中读取字节。 If I open a file with bytes, I need to decode the line to splite it.
如果我用字节打开一个文件,我需要解码该行以拆分它。
You can use ast.literal_eval
to convert the bytes literal to bytes:您可以使用
ast.literal_eval
将字节文字转换为字节:
Then, decode it to get string object:然后,解码它以获取字符串对象:
>>> ast.literal_eval(r"b'excited \xe2\x80\x94 but she\xe2\x80\x99s'")
b'excited \xe2\x80\x94 but she\xe2\x80\x99s'
>>> ast.literal_eval(r"b'excited \xe2\x80\x94 but she\xe2\x80\x99s'").decode('utf-8')
'excited — but she’s'
with open(file, 'r') as f_in:
for line in f_in:
tokens = line.split('\t')
# if len(tokens) < 2:
# continue
bytes_part = ast.literal_eval(tokens[1])
s = bytes_part.decode('utf-8') # Decode the bytes to convert to a string
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.