python 中的 readline() 方法有问题

Question

I have a text file named as test.txt which only contains text: This is line 1

file = open("test.txt")
print(file.readline())

now when I run this code, I get output:

ÿþThis is line 1 

Why am I getting this ÿþ at the beginning of the output??

Answer 1

Your file is UTF-16 encoded with a BOM prefix (to indicate the byte order), but your locale's default encoding is a Western European-like locale (eg latin-1 or cp1252 ), which interprets the BOM bytes (0xff followed by 0xfe) as ÿþ . The extraneous NUL bytes between each ASCII character that UTF-16 includes are likely being ignored.

Explicitly providing the correct encoding to open will let it seamlessly decode correctly, eg

with open("test.txt", encoding='utf-16') as file:
    print(file.readline())

Note that I switched to using a with statement for deterministic cleanup; the only changed needed to fix the code is adding encoding='utf-16' to the open arguments.

Answer 2

try using this

file1 = open("test.txt","r", encoding = "utf-16")