ETL / Replication from Azure SQL Database to on-premises SQL Server data warehouse

Question

I'm trying to build daily ETL process from Azure SQL Database to on-premises SQL Server data warehouse.

I have experience in ETL between on-premises SQL Servers but when it comes to Azure I'm not sure the best practise. I did some researches and got the options on ETL and ADP.

Would anyone here have similar experience before, could shed me some lights? Any comment, example or tutorial are much appreciated.

Answer 1

There are many ways can help you build daily ETL process from Azure SQL Database to on-premises SQL Server data warehouse.

I would suggest you think about Azure Data Factory or Azure SQL database Data Sync .

Data Factory can help you build a pipeline to copy the data between Azure SQL database and On-premise SQL Server. You could create a time trigger to trigger the copy daily. Ref these documents:

1. Copy and transform data in Azure SQL Database by using Azure Data Factory
2. Copy data to and from SQL Server by using Azure Data Factory

Data Sync is a feature of Azure SQL database, you can sync the data between SQL database and on-premise SQL Server automatically. I think that's the easiest and cheapest way which can achieve your request in some way. Just note the requirements and limitations .

And like @Nick said, Azure SQL database doesn't support windows authentication, please use SQL authentication or AD.

HTH.