将数据从 ec2 加载到 redshift 而不上传到 s3

Question

I am developing a java program and is looking to load data to redshift table directly from ec2 . I know s3 is a storage location. About ec2 I know only that ec2 instance is a like a virtual machine. I am now loading data from s3. Now I want to know how to load data from ec2 without the help of s3 .

Please help I am new to this

Answer 1

It is possible to do so. Since your question is too broad, I can only give relevant links from Redshift documentation:

• Explanation of the solution: http://docs.aws.amazon.com/redshift/latest/dg/loading-data-from-remote-hosts.html
• SQL reference of the Copy command: http://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-data-source-ssh.html

Answer 2

You cannot COPY from ec2 without the help of s3. See: https://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-data-source.html

You would have to connect to redshift from ec2 and perform INSERT queries.

Answer 3

An alternative method (though not better) is to insert the values as literals from SQL. It is not better b/c this is a highly inefficient data transfer method but for small data payloads works just fine.

Insert into <table> values 
    ('A', 1, 9),
    ('B', 2, 8),
    ('C', 3, 7);

Again, this is NOT a good method for transferring even moderate amounts of data. There is also SQL character length limit of 64K characters but if you are running up against this you are using this for too much data. The best method for moving large amounts of data to Redshift is COPY from S3.