Dataflow job drain 长时间没有结束
[英]Dataflow job drain does not end for a long time
问题描述
Draining of Dataflow streaming job does not end while 1 days. 
Dataflow 流作业的排空不会在 1 天内结束。
No error log on stack driver also.堆栈驱动程序也没有错误日志。
job ID is工作编号是
2018-03-09_00_40_49-15224076611250277770
2018-02-12_22_35_23-4736481063361562693
What's the problem?有什么问题？
And, How can I know when this drainig job complete?而且，我怎么知道这个排水工作何时完成？ (predict time) （预测时间）
2 个解决方案
解决方案1
1 2022-02-28 08:34:05
Streaming pipelines that throw unhandled exceptions while processing data currently can not be drained.当前无法排出在处理数据时抛出未处理异常的流式管道。
https://issuetracker.google.com/issues/147124216 https://issuetracker.google.com/issues/147124216
https://cloud.google.com/dataflow/docs/resources/faq#how-are-java-exceptions-handled-in-cloud-dataflow https://cloud.google.com/dataflow/docs/resources/faq#how-are-java-exceptions-handled-in-cloud-dataflow
解决方案2
0 2018-03-27 12:37:33
Have you tried to update your job with higher machine type? 您是否尝试过使用更高机器类型更新您的工作？ Maybe it is just a too heavy process for it to drain (lots of data is included). 也许这是一个非常耗时的过程（包括大量数据）。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.