工作编排
[英]Job orchestration
问题描述
I am currently redoing all our database orchestration jobs (ETL, backups, daily tasks, report compilation, etc.) 
我目前正在重做所有数据库业务流程作业（ETL，备份，日常任务，报表编译等）
To do that, I would need a task/job orchestrator where I can define tasks dependency, time based tasks, async tasks, etc. 为此，我需要一个任务/工作协调器，我可以在其中定义任务依赖，基于时间的任务，异步任务等。
I was looking at celery and Flow Based Programming technologies but I am not sure these are good for my use case. 我正在研究芹菜和基于流程的编程技术，但我不确定这些对我的用例有好处。
I am looking more at a framework that would support all these things out of the box. 我正在寻找一个能够支持所有这些开箱即用的框架。 Any suggestions? 有什么建议？
1 个解决方案
解决方案1
3
Probably to late, but I wanted to mention Job runner for possibly other people arriving at this question. 可能要迟到，但我想提到Job runner可能是其他人到达这个问题。
From their GitHub repository README.rst: 从他们的GitHub存储库README.rst：
Job-Runner is a crontab like tool, with a nice web-frontend for administration and (live) monitoring the current status. Job-Runner是一个类似于crontab的工具，有一个很好的Web前端，用于管理和（实时）监控当前状态。
Features: 特征：
- Schedule recurring jobs 安排定期工作
- Chaining of jobs 工作的链接
- Load-balance workers by putting them in a pool 通过将工作人员放入池中来平衡工作负载
- Schedule jobs to run on all workers within a pool 安排作业在池中的所有工作人员上运行
- Live dashboard (with option to kill runs and ad-hoc scheduling) 实时仪表板（可选择终止运行和临时调度）
- Multiple projects and per-project permission management 多个项目和每个项目的权限管理
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.