Error code DFExecutorUserError / Problem with loading a CSV file from Blob storage to an Azure SQL Database

Question

I am having trouble with importing a CSV file to Azure SQl Database, it dives me the following error:

Error code: DFExecutorUserError; Failure type: User configuration issue; Details: Job failed due to reason: The given value of type NVARCHAR(360) from the data source cannot be converted to type nvarchar(50) of the specified target column. Source: Pipeline pipeline1; Data flow dataflow1; Monitor: Data flow activity Data flow1

The Dataflow consists of a source, derived column (where I convert the datatypes of a few columns from string to int and date) and a sink.

One of the Columns (Message) has a lot text on every row (most of all e-mails from customers) and on that column I have set varchar max in the Database.

Thanks in advance for the replies.

Answer 1

In my System I tried to reproduce the similar issue and also got the same error as you.

The main cause of error is when we move data from blob to SQL and we have already created table with small column size can trigger this issue. as we cannot enter value in column beyond its size.

To resolve this either at time of creation of table if you don't know the size of column then set it to max or ad the precopy script to sql alter column size to max and then run your pipeline.

ALTER TABLE table_name ALTER COLUMN column_name varchar(max)

Pipeline executed successfully.