COPY ... FROM LOCAL 不会在控制台上输出错误

Question

COPY .. FROM LOCAL does not output error on console. For example:

create table test (col1 INT);

and I have a file ( abc.data ) containing data to insert to the table test as below

1237232632624232
111
222

I used the command as below to insert data into table

COPY test from local 'abc.data';

I expect it outputs error (overflow) on console. However, it does not. I workarounded by using EXCEPTIONS to output the error to file.

How do you know the way to output the error on console? Thanks in advance.

Answer 1

By default, Vertica doesn't fail COPY command on every bad row. Instead, It writes the errors and the bad rows to files in a directory called CopyErrorLogs located under Vertica's catalog path.

You can choose another location for those error files using EXCEPTIONS and REJECTED DATA options (like you did).

Or, which may be more convenient, write the errors and bad data into a table:

COPY test from local 'abc.data' REJECTED DATA as TABLE test_rejected;

Then, you can analyze test_rejected with sql

dbadmin=> \x
Expanded display is on.
dbadmin=> select * from test_rejected limit 1;
-[ RECORD 1 ]---+------------------------------------------------------------------
file_name       | abc.data
row_number      | 1
rejected_data   | 1237232632624232123243214
rejected_reason | int8 out of range '1237232632624232123243214' for column 1 (col1)

If you wish to fail COPY command on every bad row use ABORT ON ERROR . eg:

dbadmin=> COPY test from local 'abc.data' ABORT ON ERROR;
ERROR 2035:  COPY: Input record 1 has been rejected (int8 out of range '1237232632624232123243214' for column 1 (col1))

Answer 2

You can use REJECTMAX 1 if you want the copy command to fail with an error message when a row is rejected (although it won't be specific). Then you can investigate further using the exceptions and rejected data files or rejected data table.

Further reading in the documentation on load errors: https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/AdministratorsGuide/BulkLoadCOPY/CapturingLoadExceptionsAndRejections.htm

Answer 3

尝试这个：

load data infile 'abc.data' into table test fields terminated by ',';