通过 Azure Datafactory V2 将简单的 Json 导入 Sql 表

Question

我想将 Azure Datalake V2 blob 中的 Daily JSON 文件复制到 Azure Z139C4883EB01EDDAZ3 数据库C4883EB01ED95 数据库中

--简单的JSON代码结构

{
    "EmpRec": [{
            "PersNo": 5553345,
            "FirstName": "David",
            "LastName": "Bishop",
            "ContrType": "Permanent",
            "Age": 45,
            "Length": 5,
            "Wsr": "1001WK01 ",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "35,12",
            "SeptTHome": "50,40",
            "AugTHome": "10,0",
            "Site": "Home Depot",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553346,
            "FirstName": "Norris",
            "LastName": "OFdachuck",
            "ContrType": "Permanent",
            "Age": 42,
            "Length": 2,
            "Wsr": "1001WK012",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "66,35",
            "SeptTHome": "72,32",
            "AugTHome": "68,02",
            "Site": "Normandy",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553347,
            "FirstName": "List",
            "LastName": "Forbes",
            "ContrType": "Permanent",
            "Age": 30,
            "Length": 1,
            "Wsr": "1001WK011",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "35,12",
            "SeptTHome": "68,02",
            "AugTHome": "66,31",
            "Site": "Normandy",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553348,
            "FirstName": "Childs",
            "LastName": "Play",
            "ContrType": "Delivery",
            "Age": 25,
            "Length": 3,
            "Wsr": "1001WK10",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "Office Workers ",
            "SeptTHome": "50,40",
            "AugTHome": "10,0",
            "Site": "Balamb Garden",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553349,
            "FirstName": "Rob",
            "LastName": "Black",
            "ContrType": "Permanent",
            "Age": 28,
            "Length": 10,
            "Wsr": "1001WK05",
            "WorkSchedule": "Packing",
            "OctTHome": "66,35",
            "SeptTHome": "72,32",
            "AugTHome": "68,02",
            "Site": "Fisherman's Horizon",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }
    ]

预计要上传 5 条记录，但只加载第一条记录。 有没有关于将 JSON 加载到 SQL 的好教程？ ADFV2 可以处理这个还是我应该恢复到 OPENJSON？

Answer 1

所以我设法提取了一些 Azure SQL 数据到 JSON ，这是警告。 JSON 和 XML 一样有多种结构。 确保您的 JSON 是 ADFV2 数据导入和导出的最扁平形式。

Assuming the JSON on the right could potentially load multiple tables, just not sure if ADFV2 is at this point able to Copy any JSON format to Azure SQL DB tables.

Answer 2

Json 是受支持的文件格式，您必须创建数据集并正确配置。 请记住在发布和运行管道之前使用“预览数据”按钮查看配置是否正常工作。

文档链接： https://docs.microsoft.com/en-us/azure/data-factory/format-json

希望这有帮助！