Aws Glue Workflow 多次触发一项工作（不正确的行为）
[英]Aws Glue Workflow triggering multiple times one job (incorrect behavior)
问题描述
I have a big glue workflow (about 100 jobs / crawlers), and it was executing properly until last week.
我有一个很大的胶水工作流程（大约 100 个作业/爬虫），直到上周它都在正常执行。 Since then, my first conditional trigger (ALL), is executing 20 time the same job.从那时起，我的第一个条件触发器 (ALL) 执行了 20 次相同的作业。
I've configured the job it self, to just allow 1 parallel execution, but every time the workflow executes, it tries to launch 20 times (the same job).我自己配置了作业，只允许 1 次并行执行，但每次执行工作流时，它都会尝试启动 20 次（同一作业）。
Also configured the workflow, to allow a max concurrency of 1, but that doesn't fix the problem.还配置了工作流，以允许最大并发数为 1，但这并不能解决问题。
Since i started working with glue workflow, i've noticed that the tool it self is buggy, old and maybe deprecated?自从我开始使用胶水工作流程以来，我注意到它本身的工具有问题、陈旧，而且可能已被弃用？
Any tips on how to fix this problem?有关如何解决此问题的任何提示？
1 个解决方案
解决方案1
0 2023-02-01 14:48:15
I too have faced similar problems.我也遇到过类似的问题。 Even one is fixed, some other issue would occur lately.即使一个是固定的，最近也会出现其他问题。 So my suggestion is to try using step functions.所以我的建议是尝试使用阶跃函数。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.