用django-adaptors导入csv文件

Question

我正在尝试使用django-adaptors导入csv文件，不幸的是我在此过程中出错。

我创建了我的模型和CSV类，如下所示：

class depts(models.Model):
    iddepts = models.AutoField(primary_key=True)
    CustomerID = models.IntegerField(default=0, null=False)
    CustomerName = models.CharField(max_length=750, default='none', null=False)
    InvoiceID = models.IntegerField(max_length=20, default=0, null=False)
    Currency = models.CharField(max_length=3, default='EUR', null=False)
    CurrencyRate = models.DecimalField(max_digits=5, decimal_places=2) 
    PriceWithoutVAT = models.DecimalField(max_digits=20, decimal_places=2)
    PriceWithVAT = models.DecimalField(max_digits=20, decimal_places=2)
    VAT = models.DecimalField(max_digits=20, decimal_places=2)
    CustomerVATID = models.CharField(max_length=35, default='000-000-000-000', null=False)
    CustomerAddress = models.CharField(max_length=750, default='none', null=False)
    InvoiceBranch = models.IntegerField(max_length=3, default='000', null=False)
    InvoiceVATType = models.IntegerField(max_length=1, default='1', null=False)
    InvoiceDateCreate = models.DateField(auto_now=True)
    InvoiceDateDue = models.DateField(auto_now=True)
    InvoiceCodeVAT = models.CharField(max_length=20, default='none', null=False)
    PriceWithoutVATStandard = models.DecimalField(max_digits=20, decimal_places=2)
    PriceWithVATStandard = models.DecimalField(max_digits=20, decimal_places=2)
    VATStandard = models.DecimalField(max_digits=20, decimal_places=2)
    AccountVAT = models.CharField(max_length=20, default='none', null=False)
    AccountPriceWithoutVAT = models.CharField(max_length=20, default='none', null=False)
    AccountPriceWithVAT = models.CharField(max_length=20, default='none', null=False)
    class Meta:
            verbose_name = "Invoice"
            verbose_name_plural = "Invoices"
    def __str__(self):
        return self.InvoiceID        
    def __unicode__(self):
        return self.InvoiceID
class MyCsvModel(CsvDbModel):
    class Meta:
          dbModel = depts
          delimiter = ";"
          has_header = True

我的csv文件如下所示：

CustomerID;CustomerName;InvoiceID;Currency;CurrencyRate;PriceWithoutVAT;PriceWithVAT;VAT;CustomerVATID;CustomerAddress;InvoiceBranch;InvoiceVATType;InvoiceDateCreate;InvoiceDateDue;InvoiceCodeVAT;PriceWithoutVATStandard;PriceWithVATStandard;VATStandard;AccountVAT;AccountPriceWithoutVAT;AccountPriceWithVAT
73269;Good CO;131002919;EUR;1;141.12;173.58;32.46;666-666-11-11;Good street 123;002;1;2013-04-15;2013-04-22;21% ;141.12;173.58;32.46;111-111;111-111-111;111-111-11111

您可以看到，我有额外的Field im模型“ iddepts”，这是主键，将其排除在MyCsvModel剂量问题之外。 我在import_data上仍然有错误。

>>>from app.models import MyCsvModel
>>>my_csv_list = MyCsvModel.import_data(data = open("file.csv"))
Traceback (most recent call last):
File "<console>", line 1, in <module>
File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/sitepackages/adaptor/model.py", line 197, in import_data
return importer.import_data(data)
File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/adaptor/model.py", line 467, in import_data
self.process_line(data, line, lines, line_number, self.csvModel)
File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/adaptor/model.py", line 487, in process_line
raise CsvDataException(line_number, error="Number of fields invalid")
CsvDataException: Line 2: Number of fields invalid

提前致谢。

Answer 1

使用CsvDbModel意味着您的Django模型字段和CSV列匹配。 您的CSV数据缺少iddepts列。

因此，您需要创建一个django-adaptors CsvModel。 您需要告诉DateField日期的格式。 在您的CSV文件中：

'％Y-％间 - ％d'

django-adaptors 默认为 ：

'％d /％米/％Y'

设置此模型。 如果Csv模型的字段名称与django模型的字段名称不匹配，则可以使用match关键字进行管理

from adaptor.model import CsvModel
from adaptor.fields import CharField, IntegerField, DecimalField, DateField

from application.models import depts      

class DeptsCsvModel(CsvModel):

    CustomerID = IntegerField()
    CustomerName = CharField()
    InvoiceID = IntegerField()
    Currency = CharField()
    CurrencyRate = DecimalField() 
    PriceWithoutVAT = DecimalField()
    PriceWithVAT = DecimalField()
    VAT = DecimalField()
    CustomerVATID = CharField()
    CustomerAddress = CharField()
    InvoiceBranch = IntegerField()
    InvoiceVATType = IntegerField()
    InvoiceDateCreate = DateField(**{'format':'%Y-%m-%d'})
    InvoiceDateDue = DateField(**{'format':'%Y-%m-%d'})
    InvoiceCodeVAT = CharField()
    PriceWithoutVATStandard = DecimalField()
    PriceWithVATStandard = DecimalField()
    VATStandard = DecimalField()
    AccountVAT = CharField()
    AccountPriceWithoutVAT = CharField()
    AccountPriceWithVAT = CharField()

    class Meta:
        dbModel = depts
        delimiter = ";"
        has_header = True

使用此模型，您可以使用django shell导入CSV文件。 我确实将您的CSV数据成功导入到SQL数据库表中。

gottfried@lubuntu-virtual-machine:~/virtualenvs/django-adaptors/soquestion/application$ ../../bin/python ../manage.py shell
Python 2.7.2+ (default, Jul 20 2012, 22:12:53) 
[GCC 4.6.1] on linux2
Type "help", "copyright", "credits" or "license" for more information.
(InteractiveConsole)
>>> from application.adaptors import DeptsCsvModel
>>> DeptsCsvModel.import_data(data = open('data.csv'))
[<application.adaptors.DeptsCsvModel object at 0x93efa8c>]

自定义选项：您甚至可以在CSV数据中创建与日期格式匹配的自定义字段。

class DeptsDateField(DateField):
    "encapsulate specific data properties into a class for use with django-adaptors CsvModel fields"

    def __init__(self):
        super(DeptsDateField, self).__init__(**{'format':'%Y-%m-%d'})

class DeptsCsvModel(CsvModel):

    CustomerID = IntegerField()
    CustomerName = CharField()
    InvoiceID = IntegerField()
    Currency = CharField()
    CurrencyRate = DecimalField() 
    PriceWithoutVAT = DecimalField()
    PriceWithVAT = DecimalField()
    VAT = DecimalField()
    CustomerVATID = CharField()
    CustomerAddress = CharField()
    InvoiceBranch = IntegerField()
    InvoiceVATType = IntegerField()
    InvoiceDateCreate = DeptsDateField
    InvoiceDateDue = DeptsDateField
    InvoiceCodeVAT = CharField()
    PriceWithoutVATStandard = DecimalField()
    PriceWithVATStandard = DecimalField()
    VATStandard = DecimalField()
    AccountVAT = CharField()
    AccountPriceWithoutVAT = CharField()
    AccountPriceWithVAT = CharField()

    class Meta:
        dbModel = depts
        delimiter = ";"
        has_header = True