Capture HTTP 404 in Azure Data Factory

Question

How do we capture HTTP 404 and not fail an ADF pipeline

The requirement is to check the HTTP response. If the HTTP response is 404, by default the Copy Activity fails with an error. But, we do not want to fail the pipeline. Instead, we want to check the response and stop further processing.

We have tried using Lookup activity, but the Lookup activity also fails, if we have a HTTP 404 response. We can write a Custom API and check the response in there, but, we do not want to do that.

Is there any native ADF way to accomplish this.

Answer 1

1.You could get idea of Validation activity :

Activity will block execution until it has validated this dataset reference exists and that it meets the specified criteria, or timeout has been reached.

2.Also you could try to use Execute Pipeline activity to execute your specific pipeline and get the output of activity.( Error Handling on Azure Data Factory V2 )

BTW,you could vote up this feedback case to push the progress about Throw Error Activity in ADF.