[英]Realtime replication of data from Azure SQL database to Synapse
I have a few Azure SQL databases in production and would like to replicate the data in near real time to a Synapse SQL pool.我在生产中有几个 Azure SQL 数据库,并希望将数据近乎实时地复制到 Synapse SQL 池。 The reason is that I have to offload some of the analytical work from the production databases and reduce the overall load on the production databases.原因是我必须从生产数据库中卸载一些分析工作并减少生产数据库的整体负载。
I currently have a pipeline in ADF with delta tables and a tumbling window that moves the data.我目前在 ADF 中有一个带有增量表的管道和一个移动数据的翻转 window。 This works fine, but I need to get this closer to real time.这很好用,但我需要让它更接近实时。
Do any of you have any experience with moving data in near realtime from Azure SQL Servert to Synapse SQL pool?你们中的任何人有任何将数据从 Azure SQL Servert 近乎实时地移动到 Synapse SQL 池的经验吗?
Is there something similar to Cosmos HTAP?有没有类似于 Cosmos HTAP 的东西?
Actually, there isn't a realtime Data Sync tool or service from Azure SQL database to Synapse SQL pool.实际上,没有从 Azure SQL 数据库到 Synapse SQL 池的实时数据同步工具或服务。
Since you currently have a pipeline in ADF with delta tables and a tumbling window that moves the data.由于您目前在 ADF 中有一个带有增量表的管道和一个移动数据的翻转 window。 You have two ways which are most close to real time:您有两种最接近实时的方式:
HTH. HTH。
You can implement this feature with custom code but Azure Data Factory is not optimal when (near) realtimeness is required.您可以使用自定义代码实现此功能,但当需要(接近)实时性时,Azure 数据工厂并不是最佳选择。 Microsoft has announced plans for Azure Synapse Link for Azure SQL Database and it will help you getting (near) real-time replication from DB to Synapse.微软宣布了 Azure Synapse Link 的计划,用于 Azure SQL 数据库,它将帮助您获得从数据库到 Synapse 的(近)实时复制。 This would be perfect fit for your needs.这将非常适合您的需求。 The announcement was stated in the ”Shape Your Future with Azure Data and Analytics” event where Purview and Synapse new features GA was published on 3rd Dec '20.该公告在“使用 Azure 数据和分析塑造您的未来”活动中陈述,Purview 和 Synapse 新功能 GA 于 20 年 12 月 3 日发布。
If waiting for a while is an option, I would recommend waiting for Microsoft updates on this.如果等待一段时间是一种选择,我建议等待微软对此的更新。 The availability for public preview is not yet announced.公共预览版的可用性尚未公布。 Stay tuned!敬请关注!
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.