简体   繁体   中英

How to design a CDC staging table? SSIS OLE DB Command too slow

My control flow task looks like the following:

在此处输入图片说明

My data flow task looks like the following:

在此处输入图片说明

When sourcing data from a CDC enabled table I hit a bottle neck when performing row-by-row updates using the OLE DB Command. I am seeing huge performance hits and long run times for small amounts of records. I want to be able to run this at intervals of 2-3 minutes but am seeing run times of around 1hr :( I have heard of people using staging tables (OLE DB Destination) instead of the OLE DB Command on destination tables.

How are these intermediate staging tables usually designed? Are they duplicates of the lsn entries in the CDC tables or am I inserting SQL Commands into these tables to be ran in batch later in the control task? How do I apply changes from my intermediate tables to the final destination tables?

Create two staging table(update and delete) and process the changes in batch. You can find more detail here --> https://www.mattmasson.com/2011/12/cdc-in-ssis-for-sql-server-2012-2/

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM