在 Python 3 中读取文件时编码错误？

Question

When I read a file in python and print it to the screen, it does not read certain characters properly, however, those same characters hard coded into a variable print just fine. Here is an example where "test.html" contains the text "Hallå":

with open('test.html','r') as file:
    Str = file.read()
print(Str)
Str = "Hallå"
print(Str)

This generates the following output:

hallå
Hallå

My guess is that there is something wrong with how the data in the file is being interpreted when it is read into Python, however I am uncertain of what it is since Python 3.8.5 already uses UTF-8 encoding by default.

Answer 1

Function open does not use UTF-8 by default. As t he documentation says:

In text mode, if encoding is not specified the encoding used is platform dependent: locale.getpreferredencoding(False) is called to get the current locale encoding.

So, it depends, and to be certain, you have to specify the encoding yourself. If the file is saved in UTF-8, you should do this:

with open('test.html', 'r', encoding='utf-8') as file:

On the other hand, it is not clear whether the file is or is not saved in UTF-8 encoding. If it is not, you'll have to choose a different one.