简体   繁体   English

Azure Data Factory是否可以提取存储在Azure Data Lake Store中的XML文件?

[英]Can Azure Data Factory ingest an XML file stored in Azure Data Lake Store?

Is there some way to ingest XML files from the Azure Data Lake Store Gen1? 有什么方法可以从Azure Data Lake Store Gen1提取XML文件吗? I'm attempting to create a DataSet in Azure Data Factory using Azure Data Lake Store Gen1. 我正在尝试使用Azure Data Lake Store Gen1在Azure Data Factory中创建数据集。 However, XML doesn't appear to be a supported file format - only delimited files, etc. 但是,XML似乎不是受支持的文件格式,只有分隔的文件等。

I have imported an XML file into a folder structure inside of the Azure Data Lake Store. 我已经将XML文件导入到Azure Data Lake Store内部的文件夹结构中。 I am now trying to create a DataSet inside of Azure Data Factory. 我现在正在尝试在Azure数据工厂内部创建一个数据集。 I have to choose Azure Data Lake Store Gen1 to select my file in the folder structure which it does just fine. 我必须选择“ Azure Data Lake Store Gen1”以在文件夹结构中选择我的文件,该文件结构还可以。 However, there is no XML format option – only delimted and other file formats that are NOT XML! 但是,没有XML格式选项–只有Delimed和其他非XML的文件格式!

What is the work-around for this? 解决方法是什么? I have to believe there is some way to ingest XML files from the Azure Data Lake Store, correct?? 我必须相信有某种方法可以从Azure Data Lake Store提取XML文件,对吗?

The workaround solution is to create a custom activity, please refer to the offical document Use custom activities in an Azure Data Factory pipeline , its purpose as below. 解决方法是创建自定义活动,请参考Use custom activities in an Azure Data Factory pipeline的官方文档,其目的如下。

To move data to/from a data store that Data Factory does not support, or to transform/process data in a way that isn't supported by Data Factory, you can create a Custom activity with your own data movement or transformation logic and use the activity in a pipeline. 要将数据移至Data Factory不支持的数据存储中或从其中移出数据,或以Data Factory不支持的方式转换/处理数据,您可以使用自己的数据移动或转换逻辑来创建Custom活动并使用管道中的活动。 The custom activity runs your customized code logic on an Azure Batch pool of virtual machines. 自定义活动在虚拟机的Azure批处理池上运行自定义的代码逻辑。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 XML 文件使用 Azure 数据工厂 - XML File Using Azure Data Factory 在Azure数据工厂中针对Azure SQL Server进行XML文件验证 - XML File Validation Against Azure SQL Server in Azure Data Factory Azure 数据工厂中的 XML 验证 - XML validation in Azure Data Factory 无法从 azure 数据块中将文件保存在 azure 数据湖中 - Failed to save a file in azure data lake from azure data bricks 使用 azure 数据工厂将多个 xml 文件合并到 csv 文件 - Merging multiple xml files to a csv file using azure Data Factory Azure 数据工厂将数据从 XML 复制到 SQL 突触池 - Azure Data Factory copy data from XML to SQL Synapse pool 如何使用 Azure 数据工厂将 XML 元素读入变量 - How to read an XML element into a variable with Azure Data Factory 通过 Azure 数据工厂 V2 将 XML 数据加载到 SQL 表(Azure)中 - Load XML Data Into SQL Table (Azure) via Azure Data Factory V2 Azure 数据工厂 (ADF) - 解析/展平 XML 文件 - 获取所有元素的内容匹配通配符标准并位于层次结构中的不同段 - Azure Data Factory (ADF) - Parse/Flatten XML file - Get content of all elements match wildcard criteria and sitting in different segments in Hierarchy 如何在 Azure 数据工厂中使用复制数据活动将 xml 解析为 json 时删除转义字符? - How to remove escaped character when parsing xml to json with copy data activity in Azure Data Factory?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM