简体   繁体   English

如何在Azure数据工厂中计划管道

[英]How to Scheduling a Pipeline in Azure Data Factory

I followed the tutorials of MS and created a pipeline to move data from the on premise SQL Tablet to Azure Blob and then there's another pipeline to move the blob data to azure sql table. 我按照MS的教程进行操作,并创建了将数据从内部SQL Tablet移至Azure Blob的管道,然后还有另一个管道将Blob数据移至Azure SQL表。 From the document provided, I need to specify the active period (start time and end time) for the pipeline and everything run well. 从提供的文档中,我需要指定管道的活动时间段(开始时间和结束时间),并且一切运行良好。

The question is what can I do if I want the pipeline to be activated every 3 hours, until I manually stop the operation. 问题是,如果我希望每3小时激活一次管道,直到手动停止操作,该怎么办。 Currently I need to change the start time and end time in the json script and publish it again everyday and I think there should be another way to do it. 目前,我需要在json脚本中更改开始时间和结束时间,并每天再次发布它,我认为应该有另一种方法。

I'm new to azure, any help/comment will be appreciate, thank you. 我是天蓝色的新手,感谢您的任何帮助/评论。

ps I can't do the transactional replication since my on-premise SQL is lied on SQL2008. ps我无法进行事务复制,因为我的本地SQL依赖于SQL2008。

You can set infinity as the end of the pipeline: 您可以将无穷大设置为管道的结尾:

"end": "9999-99-99T12:00:00Z

and in Your activity, add 然后在您的活动中添加

"scheduler": {
     "frequency": "Hour",
     "interval": 3
},

to set scheduler. 设置调度程序。 I do not see posibility to manually stop pipeline(except restart). 我看不到手动停止管道的可能性(重启除外)。

It's not quite clear what you're trying to do from the description but if the goal is to have it temporarily "not run" you could just pause the Pipeline itself viz.: 从描述中还​​不清楚您要做什么,但是如果目标是暂时“不运行”,则可以暂停管道本身,即:

"properties": {
        "isPaused": false,
}

Set that to "true" in your pipeline and re-deploy and it's paused. 在您的管道中将其设置为“ true”,然后重新部署,它已暂停。 You could then set it back to "false" and unpause it the next day. 然后,您可以将其设置回“ false”,并在第二天取消暂停。

Keep in mind that if you have slice activity scheduled during the paused period it will run at the time it's unpaused. 请记住,如果您在暂停期间安排了切片活动,它将在未暂停时运行。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM