Azure SQL 具有接收器存储过程的数据工厂复制活动

Question

I cant get this going and seem not to find solutions on this forum. I am new to Azure

I have successfully established a direct SQL Query copy activity from on Prem SQL Server to Azure SQL.

When I proceed to edit to include a Stored Procedure it fails. I have created a data type and stored procedure as follows in the Azure Sql;

CREATE TYPE [dbo].[Patch] AS TABLE(
    [BaseKey] int,
    [GISKey] [varchar](10),
    [ActiveFrom] datetime
)
DROP PROC IF EXISTS dbo.spCopyPatch
GO
CREATE PROC dbo.spCopyPatch
@Patch dbo.Patch READONLY,
@BaseKey int,
@GISKey varchar(10),
@ActiveFrom datetime
AS
INSERT INTO dbo.Patch( BaseKey,GISKey,ActiveFrom)
VALUES(@BaseKey,@GISKey,@ActiveFrom);
GO

I then proceeded to edit the copy activity Sink. It is able to pick up the Stored Procedure OK;

However this fails on debug: Am I getting it right or missing something?

Your help highly appreciated in advance.

Answer 1

I resolved this and wrote direct from OnPrem SQL Server to Azure SQL Server.

Step 1. Update Source with the a dataset drawn from the SQL.

Step 2. Updated My Stored Procedure to what is highlighted in green below

Step 3. Populate Sink in order and shown below

Debug Copy activity and you have it

Answer 2

usually there are 2 ways to data transformations in ADF based on the logic which you see:

for ELT:

1. You copy activity wherein you copy the data from source into destination as is and then use stored procedures activity to trigger stored procedures that do the needed transformations. SO in your case you can create a table in your sink and via copy activity map the source table to the sink table. Then call the stored procedure activity to do your transformations

for ETL:

1. There are data flows wherein you can do transformations to your data before loading them into sink