[英]Azure Data Factory V2 exploring pipeline dependencies
I am working with quite a lot of pipelines, and with that involves a lot of dependencies between pipelines.我正在使用相当多的管道,这涉及管道之间的很多依赖关系。
This isn't ideal for a couple reasons:由于以下几个原因,这并不理想:
Ideally I should be able to "select" a random pipeline and be able to know what pipelines dependencies it has for both before and after execution.理想情况下,我应该能够“选择”一个随机管道,并且能够知道它在执行前后都有哪些管道依赖项。
I was thinking about using the Data Factory SDK's to try and build the dependency structure of all my pipelines.我正在考虑使用数据工厂 SDK 来尝试构建我所有管道的依赖结构。 But thought I would chuck this out there to see if anyone has discovered any solutions for this, or have any ideas before going down a rabbit hole.
但我想我会把它扔在那里,看看是否有人发现了任何解决方案,或者在进入兔子洞之前有任何想法。
I appreciate any advice.我很感激任何建议。
Cheers, Brendan干杯,布伦丹
Brendan, our ADF is connected to git and so when I need to know what will be affected if I change the pipeline with say name somePipelineName
, I goto git bash and type out Brendan,我们的 ADF 已连接到 git,因此当我需要知道如果更改管道名称为
somePipelineName
会受到什么影响时,我转到 git bash 并输入
grep --color=always -4 "somePipelineName" *
on the pipelines folder在管道文件夹上
This helps me find all places from where the pipeline may be called.这有助于我找到可以调用管道的所有位置。
Update: 2020-09-17更新:2020-09-17
I noticed today that we now have the related pipelines listing我今天注意到我们现在有相关的管道列表
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.