将大文件上传到 AWS aurora postgres serverless

Question

I have been trying for days to copy a large CSV file to a table in PostgreSQL I am using PGadmin4 to access the database. I have a file on my system the file is 10 GB so I am getting starting error when trying to upload it via UI or \\copy command.

Answer 1

When talking about 10 GB CSV file, then you may use as well different options

• I believe \\copy should work, you did not provide any more information about the issue

• I'd personally use the AWS Glue - an ETL service which could read from an S3 file