Azure 容器定期同步

Question

I have a scenario where i am storing payload from 2 subscriber (Service bus topics) into 2 different storage/container. Storing mechanism are different in these case. Now i have to run a sync every 30 minutes which will compare the files created target and Source, if anything is missing in the target it should be able to copy that file from source to target.

I am looking at AZCopy sync, but that is a local application. There are logic app and Function app option as well.

Kindly share what is the best solution to this problem

Answer 1

This method is a little on the brute force side, but should work. Here is the top level pipeline diagram:

Here are the steps:

1. Get Metadata for the "Needs sync" folder (FolderA). Be sure to check add the "Child items" argument:

2. ForEach over the FolderA child items to extract the file names and append them to an array variable:

This makes it easier to work with the names later.

3. Get Metadata for the "Always right" folder (FolderB). Same process as above, but over the FolderB location.

4. ForEach over FolderB's child items.

5. Inside the ForEach, add an If Condition to test whether or not the FolderB item exists in the FolderA list.

6. If the FolderB item is not in the FolderA list, append it to a Missing_Items array variable.

From here, it's a matter of looping over the Missing Items array and handling it however you prefer [probably with a Copy activity].