[英]How to use REST API as source for Lookup activity in Azure Data Factory
I am trying to incrementally load data from a ServiceNow data source into an Azure SQL table as per the guide from Microsoft https://learn.microsoft.com/en-us/azure/data-factory/tutorial-incremental-copy-portal .我正在尝试按照 Microsoft https 的指南将数据从 ServiceNow 数据源增量加载到 Azure SQL 表中://learn.microsoft.com/en-us/azure/data-factory/tutorial-incremental-copy-portal . This uses 2 lookup activities to find 2 dates, I then filter the source data in the copy activity to only return and insert rows where the sys_updated_on date is between the 2 lookup values.这使用 2 个查找活动来查找 2 个日期,然后我过滤复制活动中的源数据以仅返回和插入 sys_updated_on 日期在 2 个查找值之间的行。
I would now like to lookup a value from a REST API dataset.我现在想从 REST API 数据集中查找一个值。 However, I do not get the option to choose my REST dataset in the lookup activity.但是,我无法在查找活动中选择我的 REST 数据集。 It just does not appear as an option.它只是不作为一个选项出现。 The REST URL is setup to return me one date value which I need to pass into the WHERE clause of my source in the copy data. REST URL 设置为返回一个日期值,我需要将其传递到副本数据中源的 WHERE 子句中。 If I cannot retrieve this value in the lookup, how else can I pass it to my WHERE clause?如果我无法在查找中检索到该值,我还能如何将它传递给我的 WHERE 子句?
Currently I use activity('LookupOldWaterMarkActivity').output.firstRow.watermarkvalue and convertTimeZone(activity('LookupNewWaterMarkActivity').output.firstRow.watermarkvalue目前我使用 activity('LookupOldWaterMarkActivity').output.firstRow.watermarkvalue 和 convertTimeZone(activity('LookupNewWaterMarkActivity').output.firstRow.watermarkvalue
Thanks谢谢
As per the Microsoft official document, the Rest
dataset is supported in lookup activity.根据 Microsoft 官方文档,查找活动支持Rest
数据集。
You can post feedback from an Azure Data factory or raise a support request for fixing the issue.您可以通过 Azure 数据工厂发布反馈或提出支持请求以解决问题。
As a workaround, you can create an HTTP
dataset with JSON format and use the output value in later activities.作为解决方法,您可以创建一个HTTP
格式的 HTTP 数据集,并在以后的活动中使用 output 值。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.