将 CSV 文件从 Azure blob 存储批量插入到 SQL 托管实例

Question

I have CSV file on Azure blob storage. It has 4 columns in it without headers and one blank row at starting. I am inserting CSV file into SQL managed instance by bulkinsert and I have 5 columns in the database table. I don't have 5th column in CSV file.

Therefore it is throwing this error:

Bulk load data conversion error (type mismatch or invalid character for the specified codepage) for row 1, column 5 (uId2)

As I want to insert that 4 columns from CSV file to table in database and I want that 5th column in table as NULL.

I am using this code:

BULK INSERT testing
FROM 'test.csv'
WITH (DATA_SOURCE = 'BULKTEST',
  FIELDTERMINATOR = ',',
  FIRSTROW = 0,
  CODEPAGE = '65001',
  ROWTERMINATOR = '0x0a'
   );

Want that 5th row as NULL in database table, if there are 4 columns in CSV file.

Answer 1

Sorry, we achieve that in bulk insert. None of other ways according my experience.

Azure SQL managed instance is also not supported as dataset in Data Factory Data flow . Otherwise we can using Data Flow derived column to create a new column to mapping to the Azure SQL database.

The best way is that you editor your csv file: just add new column as header in you csv files.

Hope this helps.