Is it possible to insert 50 000 record in single statement in BIzTalk Server?

Question

I have 1 flat file it will contains more than 100k rows. I need to entry in table (Dynamic table based on data). so it is possible to insert data in batch wise in BizTalk?

Here is my Biztalk Mapping.

Biztalk project Configuration.(Batch size in 100 still insert single record at a time.)

following biztalk project add single record but need to add multiple line in once statement.

I have checked it will insert one by one record , so it will take to much time. So can anyone please provide the alternative solution for the Biztalk server to handle large data.

Answer 1

Yes, it is possible to do.

First off when you generate your database schema make sure you use the TableOp/Insert.

And in your Action of your WCF-SQL or WCF-Custom with sqlbindings have one of the below. The first if are sending multiple different Operations through the same port (then the Operation name has to match that set in the message context, either via Orchestration Logical Port Operation name or BRE rules), or the second you can use if you are only sending one type of payload.

<BtsActionMapping xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
  <Operation Name="InsertCustomer" Action="TableOp/Insert/dbo/CustomerDetails" />
  <Operation Name="InsertPO" Action="TableOp/Insert/dbo/PurchaseOrder" />
</BtsActionMapping>

or

TableOp/Insert/dbo/CustomerDetails

Of course replacing CustomerDetails with whatever table you are trying to insert into.

From the looks of it your map is probably not correct, and if you test it in Visual Studio, you would also probably get a single record, and that is where the problem is.