使用 Azure 数据工厂从 REST API 读取 JSON

Question

I'm trying to get Azure Data Factory to read my REST API and put it in SQL Server. The source is a REST API and the sink is a SQL Server table.

I tried to do something like:

"translator": {
    "type": "TabularTranslator",
    "schemaMapping": {
        "$": "json"
    },
    "collectionReference": "$.tickets"
}

The source looks like:

{ "tickets": [ {... }, {...} ] }

Because of the poor mapping capabilities I'm choosing this path. I'll then split the data with a query. Preferbly I'd like to store each object inside tickets as a row with JSON of that object.

In short, how can I get the JSON output from the RestSource to a SqlSink single column text/nvarchar(max) column?

Answer 1

I managed to solve the same issue by modifying mapping manually. ADF anyway tries to parse json, but from the Advanced mode you can edit json paths. Ex., this is the original schema parsed automatically by ADF https://imgur.com/Y7QhcDI Once opened in Advanced mode it will show full paths by adding indexes of the elements, something similar to $tickets[0][] etc Try to delete all other columns and keep the only one $tickets (the highest level one), in my case it was $value https://i.stack.imgur.com/WnAzC.jpg . As the result the entire json will be written into the destination column.

If there are pagination rules in place, each page will be written as a single row.