Data Migration from Snowflake (on GCP Instance) to Snowflake (Azure Instance)

Question

I am looking for some inputs on how to do a GCP cloud to AZURE cloud data migration.

Scenario -

I have a snowflake instance configured on GCP cloud (multiple databases holding legacy data) and I have another snowflake instance configured on Azure Cloud (DWH created on this instance).

I want to move/copy the data of all the databases (including all child objects - schema, table, views etc) sitting on GCP snowflake instance to snowflake instance configured on Azure Cloud.

Can you please guide me on what can be the best solution for such data migration and any steps or documentation link would be really helpful.

Many thanks - Minti

Answer 1

Please check the Database replication mechanism which can be used as a migration tool for SF account from 1 cloud platform to another. https://docs.snowflake.com/en/user-guide/database-replication-intro.html

Answer 2

Not something I've done before to be honest but if you didn't want to use external tools one possible method would be to secure share your GCP databases with your Azure Snowflake account.

You then might be able to create a new database that is a clone of this share (not sure if this is possible).

Most objects get cloned apart from stages and pipes but tables, views etc should carry over

Answer 3

This is a pretty easy process with a couple of prerequisites.

1. Make sure you have Organizations enabled on your GCP account.

• This feature allows you to self-provision Snowflake accounts on any cloud provider/region. Open a support case to enable it.
• Introduction to Organizations

2. Create a new account on Azure if you haven't already.

3. Enable Replication on both accounts

• This can be done when logged into the account with the ORGADMIN role

4. Replicate your databases

Note: this will work for having a replica of the databases in the GCP Snowflake account databases in your Azure Snowflake account. If you want to permanently migrate your databases you need to set upFailover/Failback . This is a Business Critical feature, but Snowflake support will enable it for lower editions until you can complete your migration, at which point they will disable it.

Replicating a Database to Another Account

Answer 4

There are two options

1. You could make use of the replication feature

High level Steps include the below a. Target account to be created - Can use the Organizations feature available in Snowflake(Enabled by Snowflake Support upon request) b. Account level objects should be created manually in the target account

Note: The Failover feature is supported for the accounts whose edition is Business-critical and above. However, for account migration scenarios, this feature will be enabled for a temporary period by the Snowflake Support.

c. Replication - the below links can be referenced for a complete understanding of the process. https://docs.snowflake.com/en/user-guide/database-replication-intro.html#introduction-to-database-replication-across-multiple-accounts https://docs.snowflake.com/en/user-guide/database-replication-config.html#replicating-a-database-to-another-account https://docs.snowflake.com/en/user-guide/database-failover-config.html#failing-over-databases-across-multiple-accounts

Please find the link below to have an overview on the costs associated https://docs.snowflake.com/en/user-guide/database-replication-billing.html#understanding-billing-for-database-replication

Limitations https://docs.snowflake.com/en/user-guide/database-replication-intro.html#current-limitations-of-replication

2. One other option is to create the target account and use the unloading and loading feature https://docs.snowflake.com/en/user-guide-data-unload.html https://docs.snowflake.com/en/user-guide-data-load.html