编码/解码Unicode和编写CSV

Question

I am trying to write words of non-latin based languages to a CSV and cannot get the words to be written in their proper form.

foreign='а также'
with open('C:\\Users\\Lance\\Desktop\\Programs\\Database Builder\\Russian Test.csv', 'wb') as outfile:
    outfile.write((foreign).encode('utf-8'))

The output of this code is:

а также

Thanks!

Answer 1

It writes the file correctly but you are probably displaying the file using an editor or console that is using Windows-1252 encoding.

Example from US Windows cmd.exe console:

C:\>type "Russian Test.csv"
а также
C:\>chcp 1252
Active code page: 1252

C:\>type "Russian Test.csv"
а также
C:\>chcp 65001
Active code page: 65001

C:\>type "Russian Test.csv"
а также

Note: code page 65001 is UTF-8 encoding on Windows.

Since you seem to be using Python 3, you should do this instead and write Unicode strings directly:

foreign='а также'
with open('Russian Test.csv', 'w', encoding='utf8') as outfile:
    outfile.write(foreign)

Answer 2

First install unicodecsv

pip install unicodecsv

Then import it in your script

import unicodecsv as csv

Worked for me.

Answer 3

firstly, writing data into csv file depends on csv library, the correct script should be:

import csv
with open('path/to/test.csv', 'wb') as f:
    writer = csv.writer(f)
    for line in <your_data>:
       writer.writerow(line)

secondly, as csv library does not support unicode in python 2x, you need use alternative that handle unicode very well -- https://github.com/jdunck/python-unicodecsv , All you have to do is simply installing unicode version of csv library, and adding short import expression at first line:

pip install unicodecsv
import unicodecsv as csv
...

Remember that convert all your strings into unicode by adding 'u' in front of each string.