如何将数据从一个表传输到另一个表（AWS 上的 DynamoDB）

Question

How do I transfer data from one table to another in DynamoDB? I'm confused because tables and table-fields look absolutely identical.

Answer 1

To copy a source table to a new destination table, then on Demand Backup and restore should do the trick. Details are here: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/backuprestore_HowItWorks.html

If you are looking to copy the data from a source DDB table to an EXISTING DDB table (and append the data to it), then consider Glue.

• DDB can be a source for Glue ETL: "connectionType": "dynamodb"
• DDB can be a destination for Glue ETL, but is a little more complicated. You will need to use the JDBC driver for DynamoDB and then set Glue to output to JDBC. There are detailed instructions here

Answer 2

If you just want to do it one time like you mention in the comments, I recommend doing a backup and restore. Restore always goes to a separate table, not the original one.

Answer 3

What do you think about this:

• Different Regions
• Python
• Pagination
• Error handling and logs

import boto3


def migrate(source, target):
    dynamo_client = boto3.client('dynamodb', region_name='us-east-1')
    dynamo_target_client = boto3.client('dynamodb', region_name='us-west-2')

    dynamo_paginator = dynamo_client.get_paginator('scan')
    dynamo_response = dynamo_paginator.paginate(
        TableName=source,
        Select='ALL_ATTRIBUTES',
        ReturnConsumedCapacity='NONE',
        ConsistentRead=True
    )
    for page in dynamo_response:
        for item in page['Items']:
            dynamo_target_client.put_item(
                TableName=target,
                Item=item
            )


if __name__ == '__main__':
    migrate('awesome-v1', 'awesome-v2')