简体   繁体   中英

Is it possible to flatten json file in Data factory copy activity?

I have a JSON file looks like below, I am not supposed to use data flow. Is it possible to flatten the file using copy activity in azure data factory?

{
        "domain_scores": [
            {
                "abc": [
                    10.5,
                    10.5,
                    10.5
                ],
                "def": [
                    16.38,
                    16.38,
                    16.38
                ],
                "name": "level1"
            },
            {
                "abc": [
                    10.5,
                    10.5,
                    10.5
                ],
                "def": [
                    16.38,
                    16.38,
                    16.38
                ],
                "name": "level2"
            },
            {
                "abc": [
                    10.5,
                    10.5,
                    10.5
                ],
                "def": [
                    16.38,
                    16.38,
                    16.38
                ],
                "name": "level3"
            }
        ],
        "tags": [
            "Data",
            "Dimension",
            "Process"
        ],
        "range": {
            "min": 10.5,
            "max": 16.375
        }
    }

or is there any other way to flatten the file in data factory?

Yes, it is possible to flatten JSON file in Copy Activity.

In Copy Activity, to flatten JSON file click on Mapping tab.

Select Collection reference.

在此处输入图像描述

Here you can do mapping of complex JSON objects.

在此处输入图像描述

Refer this article by diponkar.paul

But copy activity only pulls the first row of the array and not all the rows. I believe only dataflow can do this

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM