简体   繁体   中英

Event Trigger in Azure Data Factory

I am trying to create an Event Trigger in Azure Data Factory on Blob Created in my Azure Storage Container. The challenge I am facing in doing so is what if I receive multiple files in one single event say 10 files.

Now what happens is the event is fired 10 times and all these 10 files are executed at-least 100 times by the Data Factory.

Edit -- My pipeline does xml to json transformation.

在此处输入图像描述

The error I get

在此处输入图像描述

在此处输入图像描述

The issue I am facing is similar to Azure Data Factory - Event based triggers on multiple files/blobs

I've created a simple test. When I uploaded 10 xml files, it fires

  1. Set Wildcard file path as *.xml . 在此处输入图像描述

  2. Then I created a event trigger. 在此处输入图像描述

  3. When I uploaded 10 xml files at one time via Azure storage Explorer. I can see 10 pipeline runs. 在此处输入图像描述 And 10 blob in the output container. 在此处输入图像描述

So what are the differences between yours and mine?

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM