Copy special character in AWS Redshift

Question

I'm unable to load special character row in AWS Redshift.

Getting an error: String contains invalid or unsupported UTF8 codepoints. Bad UTF8 hex sequence: c8 4d (error 4)

The string causing the problem is: Crème (the è).

For a temporary fix, I am using:

copy dev.table (a,
b,
c,
d) from 's3://test-bucket/redshift_data_source/test_data.csv'
CREDENTIALS 'aws_access_key_id=xxxxxxxxxx;aws_secret_access_key=xxxxxxxxxxxx' CSV delimiter ',' IGNOREHEADER 1 COMPUPDATE OFF acceptinvchars;

acceptinvchars is accepting them as varchar but putting ? on those characters. How to read them as is?

Answer 1

The best solution seems to be to convert your source data to UTF-8. It is currently saved using some other encoding.