Python脚本在Spyder中完美运行（在Windows上） - 在Linux上不起作用

Question

I wrote a script that reads a .cnf file, analyses some stuff and then outputs some results (via print() ). For reading the .cnf file, I use the following line:

with open('config.cnf') as f:
file_content = f.read()

Now if I run this in the Spyder-Environment (Python 3.6), everything works fine. The scripts read config.cnf, does the operations and outputs the results. If I run the exact same script on Linux (with the config.cnf located in the same Directory), the following error message is shown:

Traceback (most recent call last):
  File "Conf2Monit_V2.py", line 45, in <module>
    file_content = f.read()
  File "/usr/lib/python3.6/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x96 in Position 29834: invalid start byte

I use the following command:

python3 myScript.py 

I am new to Python AND to Linux, so please don't be fed up if this is some basic mistake. Thank you.

Answer 1

I'm guessing the issue could be because of Historical reason behind different line ending at different platforms

If this is the case then please give a try at this

Else you can try the iconv command of Linux.

Can you check the encoding of the characters in the file by running the below command in your Linux environment:

file -i <filename>

Check if the output is something like charset=utf-8

If not then, there is a way to translate the encoding to UTF-8 as shown here

It explains how to convert the encoding of a file ("input.txt") from the code set ISO88592 to UTF8 code set or ASCII and stores the result as "output.txt".

iconv -f ISO88592 -t UTF8 input.txt output.txt

So, the steps you might want to follow are, if the file under consideration is input.txt:

1. file -i input.txt
   and let's say its output comes something like
   input.txt: text/plain; charset=iso-88592
2. iconv -f ISO88592 -t UTF8 input.txt output.txt

Answer 2

The solution was simple:

I opened the file in the Windows Editor. Then under "save as..." I was able to Change a Setting at the bottom from "ASCII" to "UTF-8". Then I transferred the file back to my Linux System et voila. Worked.