简体繁体 English

将数据与Azure数据工厂同步

[英]Syncing Data with Azure Data Factory

原文 2016-09-26 21:33:35 2 1 sql-server/ azure/ azure-sql-database/ azure-data-factory

Is it possible to set up a pipeline in Azure Data Factory that performs a MERGE between the source and the destination rather than an INSERT ? 是否可以在Azure数据工厂中设置一个在源和目标之间执行MERGE而不是INSERT的管道？ I have been able to successfully select data from my source on-prem table and insert into my destination, but I'd really like to set up a pipeline that will continually update my destination with any changes in the source. 我已经能够成功地从源本地表中选择数据并将其插入到目标中，但是我真的很想建立一个管道，该管道将通过源中的任何更改不断更新目标。 Eg copying new records that are added to the source, or updating any data which changes on an existing record. 例如，复制添加到源中的新记录，或更新现有记录上发生更改的任何数据。

I've seen references to the Data Sync framework, but from what I can tell that is only supported in the legacy portal. 我已经看到了对Data Sync框架的引用，但是据我所知，只有旧版门户网站才支持。 My V12 databases do not even show up in the class Azure portal. 我的V12数据库甚至没有显示在类Azure门户中。

1 个解决方案

There is the Stored Proc activity which could handle this. 有可以处理此问题的Stored Proc活动。 You could use Data Factory to land the data in a staging table then call the stored proc to perform the MERGE . 您可以使用Data Factory将数据放置在登台表中，然后调用存储的proc来执行MERGE 。 Otherwise Data Factory logic is not that sophisticated so you could not perform a merge in the same way you could in SSIS for example. 否则，Data Factory逻辑不是那么复杂，因此您无法以例如在SSIS中的相同方式执行合并。 Custom activities are probably not suitable for this, IMHO. 自定义活动可能不适合此操作，恕我直言。 This is also in line with Data Factory being ELT rather than ETL. 这也与Data Factory是ELT而不是ETL一致。