Convert JSON to CSV using Azure Logic Apps

Question

I need to convert every JSON message from Azure Data Lake Store into CSV record and store again in Azure Data Lake Store. Then i plan to use Azure Data Factory to load every CSV record into Azure SQL Data Warehouse.

So, as first step i am using Logic Apps to read JSON message from Azure Data Lake Store and using Parse JSON and then Create CSV table.

But getting error message in Parse JSON step: InvalidTemplate. Unable to process template language expressions in action 'Parse_JSON' inputs at line '1' and column '2732': 'Required property 'content' expects a value but got null. Path ''.'.

Could you please help how to fix this error?. Or you even propose different ways as i even tried with Liquid Templates, but it does not work.

Answer 1

For a process whose primary task is format conversion, Azure Data Factory is most probably the path you should try first.

ADF has native support for JSON and CSV (Text). ADF's JSON support is really good, but there might be instances where using a Logic App and Liquid transform might be useful as a pre-processor as well.