[英]MySQL export to CSV file as UTF-8 via Python script
I'm able to export a MySQL table into a CSV file via Python csv
module but there are no utf-8 characters. 我可以通过Python
csv
模块将MySQL表导出到CSV文件,但是没有utf-8字符。 (example: ????
chars insted of ąöę
). (例如:
????
chars ąöę
)。
The table data is in utf-8 format (phpMyAdmin let me see correct data). 表数据为utf-8格式(phpMyAdmin,让我看到正确的数据)。
I found some information that in Python all data should be decoded in utf-8 and then encoded into CSV in utf-8 via for example unicodewritter
(because the native csv
module doesn't support Unicode correctly). 我发现一些信息,在Python中所有数据都应在utf-8中解码,然后通过
unicodewritter
在utf-8中编码为CSV(因为本机csv
模块不正确支持Unicode)。
I tried a lot but no success. 我尝试了很多,但没有成功。
Question : Is there any example script to export MySQL database in utf-8 to CSV file in utf-8 format in Python? 问题:是否有示例脚本以utf-8格式将MySQL数据库导出为utf-8格式的CSV文件(在Python中)?
I use ubuntu 14.04 and there is a problem with mysql.connector so I use MySQLdb with Gord Thompson code : 我使用ubuntu 14.04,mysql.connector出现问题,因此我将MySQLdb与Gord Thompson代码一起使用:
# -*- coding: utf-8 -*-
import csv
import MySQLdb
from UnicodeSupportForCsv import UnicodeWriter
import sys
reload(sys)
sys.setdefaultencoding('utf8')
#sys.setdefaultencoding('Cp1252')
conn = MySQLdb.Connection(db='sampledb', host='localhost',
user='sampleuser', passwd='samplepass')
crsr = conn.cursor()
crsr.execute("SELECT * FROM rfid")
with open(r'test.csv', 'wb') as csvfile:
uw = UnicodeWriter(
csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
for row in crsr.fetchall():
uw.writerow([unicode(col) for col in row])
Error still exist : UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 2: invalid continuation byte 错误仍然存在:UnicodeDecodeError:'utf8'编解码器无法解码位置2的字节0xf3:无效的继续字节
MySQL is great in converting character sets. MySQL非常擅长转换字符集。 But you need to tell it to set up a connection using the correct collation.
但是您需要告诉它使用正确的排序规则来建立连接。
On default it returns how it is put into the database. 默认情况下,它返回如何将其放入数据库。 Add the required charset to the connection:
将所需的字符集添加到连接中:
conn = MySQLdb.Connection(db='sampledb', host='localhost',
user='sampleuser', passwd='samplepass', charset='utf-8', )
Is this helpful? 这有帮助吗?
This works for me with Python 2.7.5 and MySQL Connector/Python 2.0.4: 这对我适用于Python 2.7.5和MySQL Connector / Python 2.0.4:
# -*- coding: utf-8 -*-
import csv
import mysql.connector
from UnicodeSupportForCsv import UnicodeWriter
conn = mysql.connector.connect(
host='localhost', port=3307,
user='root', password='whatever',
database='mydb')
crsr = conn.cursor()
crsr.execute("SELECT * FROM vocabulary")
with open(r'C:\Users\Gord\Desktop\test.csv', 'wb') as csvfile:
uw = UnicodeWriter(
csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
for row in crsr.fetchall():
uw.writerow([unicode(col) for col in row])
The UnicodeWriter
class is taken directly from the last example on the documentation page for the csv module , which I stored in a file named "UnicodeSupportForCsv.py": UnicodeWriter
类直接取自csv模块的文档页面上的最后一个示例,该示例存储在名为“ UnicodeSupportForCsv.py”的文件中:
import csv, codecs, cStringIO
class UTF8Recoder:
"""
Iterator that reads an encoded stream and reencodes the input to UTF-8
"""
def __init__(self, f, encoding):
self.reader = codecs.getreader(encoding)(f)
def __iter__(self):
return self
def next(self):
return self.reader.next().encode("utf-8")
class UnicodeReader:
"""
A CSV reader which will iterate over lines in the CSV file "f",
which is encoded in the given encoding.
"""
def __init__(self, f, dialect=csv.excel, encoding="utf-8", **kwds):
f = UTF8Recoder(f, encoding)
self.reader = csv.reader(f, dialect=dialect, **kwds)
def next(self):
row = self.reader.next()
return [unicode(s, "utf-8") for s in row]
def __iter__(self):
return self
class UnicodeWriter:
"""
A CSV writer which will write rows to CSV file "f",
which is encoded in the given encoding.
"""
def __init__(self, f, dialect=csv.excel, encoding="utf-8", **kwds):
# Redirect output to a queue
self.queue = cStringIO.StringIO()
self.writer = csv.writer(self.queue, dialect=dialect, **kwds)
self.stream = f
self.encoder = codecs.getincrementalencoder(encoding)()
def writerow(self, row):
self.writer.writerow([s.encode("utf-8") for s in row])
# Fetch UTF-8 output from the queue ...
data = self.queue.getvalue()
data = data.decode("utf-8")
# ... and reencode it into the target encoding
data = self.encoder.encode(data)
# write to the target stream
self.stream.write(data)
# empty queue
self.queue.truncate(0)
def writerows(self, rows):
for row in rows:
self.writerow(row)
Try this one ..make easy for you 试试这个..让您轻松
https://github.com/jdunck/python-unicodecsv https://github.com/jdunck/python-unicodecsv
The unicodecsv is a drop-in replacement for Python 2.7's csv module which supports unicode strings without a hassle. unicodecsv是Python 2.7的csv模块的直接替代,该模块支持unicode字符串而没有麻烦。 Supported versions are python 2.6, 2.7, 3.3, 3.4, 3.5, and pypy 2.4.0.
受支持的版本是python 2.6、2.7、3.3、3.4、3.5和pypy 2.4.0。
>>> import unicodecsv as csv
>>> from io import BytesIO
>>> f = BytesIO()
>>> w = csv.writer(f, encoding='utf-8')
>>> _ = w.writerow((u'é', u'ñ'))
>>> _ = f.seek(0)
>>> r = csv.reader(f, encoding='utf-8')
>>> next(r) == [u'é', u'ñ']
True
Finaly it Works! 最终,它起作用了! Thanks to : Gord Thompson and Prikkeldraad .
感谢: Gord Thompson和Prikkeldraad 。 Thanks Guys !
多谢你们 !
# -*- coding: utf-8 -*-
import csv
import MySQLdb
from UnicodeSupportForCsv import UnicodeWriter
import sys
reload(sys)
sys.setdefaultencoding('utf8')
#sys.setdefaultencoding('Cp1252')
conn = MySQLdb.Connection(db='testdb', host='localhost', user='testuser', passwd='testpasswd', use_unicode=0,charset='utf8')
crsr = conn.cursor()
crsr.execute("SELECT * FROM rfid")
with open(r'test.csv', 'wb') as csvfile:
uw = UnicodeWriter(
csvfile, delimiter=',',quotechar='"', quoting=csv.QUOTE_MINIMAL)
for row in crsr.fetchall():
uw.writerow([unicode(col) for col in row])
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.