Python：从raw_input（）读取UTF-8并在文件中写入UTF-8

Question

So, i would like to make a program does 2 things:

1. Reads A Word
2. Reads the translation in Greek

Then I make a new format that looks like this: "word,translation" and i'm writing it into a file.

So the test.txt file should contain "Hello,Γεια" and in case i read again , the next line should go under this one.

word=raw_input("Word:\n")  #The Word
translation=raw_input("Translation:\n").decode("utf-8") #The Translation in UTF-8
format=word+","+translation+"\n"
file=open("dict.txt","w")
file.write(format.encode("utf-8"))
file.close()

The Error I get:

UnicodeDecodeError 'utf8'codec can't decode byte 0x82 in position 0: invalid start byte

EDIT : This is Python 22

Answer 1

Although python 2 supports unicode, its input is not automatically decoded into unicode for you. raw_input returns a string and if something other than ascii is piped in, you get the encoded bytes. The trick is to figure out what that encoding is. And that depends on whatever is pumping data into the program. if its a terminal, then sys.stdin.encoding should tell you what encoding to use. If its piped in from, say, a file, then sys.stdin.encoding is None and you just kinda have to know what it is.

A solution to your problem follows. Note that even though your method of writing the file (encode then write) works, the codecs module imports a file object that does it for you.

import sys
import codecs

# just randomly picking an encoding.... a command line param may be
# useful if you want to get input from files
_stdin_encoding = sys.stdin.encoding or 'utf-8'

def unicode_input(prompt):
    return raw_input(prompt).decode(_stdin_encoding)

word=unicode_input("Word:\n")  #The Word
translation=unicode_input("Translation:\n")
format=word+","+translation+"\n"
with codecs.open("dict.txt","w") as myfile:
    myfile.write(format)