简体   繁体   中英

What are some ways to handle bad files in Azure Datafactory Copy Activity

When using the default datafactory copy activity to load files from json blobs (source using modified timestamp) to sqldb table (destination). For the fault-tolerant settings, if the row is incompatible then it gets skipped, however if there is a bad file that is not a valid json format then the activity errors and retries instead of skipping the bad file.

What are some ways to identify/skip incompatible or corrupt files in ADF copy activity?

Thanks in advance

failure log screenshot

According to the Fault tolerance of copy activity in Azure Data Factory , the fault tolerance of copy activity only support binary files and tabular data .
Identify invalid json files is not supported yet.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM