简体   繁体   English

从 sql-client.sh 提交的 Flink 作业,如何从保存点恢复?

[英]Flink job submitted from sql-client.sh, how to resume from savepoint?

I submitted a job from apache-flink sql-client, and created a savepoint.我从 apache-flink sql-client 提交了一个作业,并创建了一个保存点。 The issue is the meta data doesn't contain jar and classname, let alone the parameters.问题是元数据不包含 jar 和类名,更不用说参数了。 How to restart?如何重启?

flink run -s hdfs://ns/flink/flink-checkpoints/savepoint-c5dade-af74904ab30c -m yarn-cluster -yid application_1539849585041_0459 -c org.apache.flink.table.client.SqlClient opt/flink-sql-client-1.6.1.jar embedded -e /opt/flink/flink-bin/yarn-app/a/sql-client-kafka-json.yaml --library /opt/flink/flink-bin//lib -u 'INSERT INTO testjsonSink SELECT * FROM testjsonSource;'` flink run -s hdfs://ns/flink/flink-checkpoints/savepoint-c5dade-af74904ab30c -m yarn-cluster -yid application_1539849585041_0459 -c org.apache.flink.table.client.SqlClient opt/flink-sql-client- 1.6.1.jar 嵌入 -e /opt/flink/flink-bin/yarn-app/a/sql-client-kafka-json.yaml --library /opt/flink/flink-bin//lib -u 'INSERT INTO testjsonSink SELECT * FROM testjsonSource;'`

Adjust jars lib.调整 jars 库。 It been solved as before.和以前一样解决了。 Poor documentation.糟糕的文档。

official working with 1.12.1 with scala 1.12: flink run -s hdfs://dbt1caw005.webex.com:9000/flink-checkpoints/savepoint-dafd7c-05d66b098493 -C file:///opt/flink/jars/flink-python_2.12-1.12.1.jar -c org.apache.flink.table.client.SqlClient /opt/flink/opt/flink-sql-client_2.12-1.12.1.jar embedded -e /vdb/sql.yml -l /opt/flink/jars -u "INSERT INTO CALL_DURATION_USER SELECT orgId, userId, window_start, window_end, total_minutes, total_calls FROM ( SELECT , ROW_NUMBER() OVER (PARTITION BY orgId,window_end ORDER BY total_minutes desc) AS rownum FROM ( SELECT orgId, userId, HOP_START(ts, INTERVAL '1' DAY,INTERVAL '30' DAY) window_start, HOP_END(ts, INTERVAL '1' DAY,INTERVAL '30' DAY) window_end, CAST(sum(cast(legDuration as bigint)/60 official working with 1.12.1 with scala 1.12: flink run -s hdfs://dbt1caw005.webex.com:9000/flink-checkpoints/savepoint-dafd7c-05d66b098493 -C file:///opt/flink/jars/flink- python_2.12-1.12.1.jar -c org.apache.flink.table.client.SqlClient /opt/flink/opt/flink-sql-client_2.12-1.12.1.jar embedded -e /vdb/sql. yml -l /opt/flink/jars -u "INSERT INTO CALL_DURATION_USER SELECT orgId, userId, window_start, window_end, total_minutes, total_calls FROM ( SELECT , ROW_NUMBER() OVER (PARTITION BY orgId,window_end ORDER BY total_minutes desc) AS rownum FROM ( SELECT orgId, userId, HOP_START(ts, INTERVAL '1' DAY,INTERVAL '30' DAY) window_start, HOP_END(ts, INTERVAL '1' DAY,INTERVAL '30' DAY) window_end, CAST(sum(cast(legDuration as bigint )/60 ) AS BIGINT) total_minutes, CAST(count( ) AS BIGINT) total_calls FROM callduration_ts GROUP BY HOP(ts, INTERVAL '1' DAY,INTERVAL '30' DAY),orgId, userId ) ) WHERE rownum < 101" ) AS BIGINT) total_minutes, CAST(count( ) AS BIGINT) total_calls FROM callduration_ts GROUP BY HOP(ts, INTERVAL '1' DAY,INTERVAL '30' DAY),orgId, userId) ) WHERE rownum < 101"

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 flink 作业有时通过 sql-client.sh 提交,没有任何检查点(改变它的方法是什么)或在失败的情况下如何恢复 - flink job submit through sql-client.sh sometime without any checkpoint (what is the way to alter it) or how to recover in case of failure Flink Job Cluster Kube.netes 从保存点恢复 - Flink Job Cluster Kubernetes restoring from savepoint 从 IDE 运行作业时如何将保存点传递给 Flink - How do I pass a savepoint to Flink when running a job from the IDE Apache Flink如何从检查点/保存点还原状态? - How does Apache Flink restore state from checkpoint/savepoint? 如何知道作业是否从保存点恢复? - How to know if a job is restored from a savepoint? 在纱簇上提交Flink Job以从其最后一个保存点恢复其状态 - Submit Flink Job on Yarn cluster to restores its state from it's last savepoint 从保存点恢复时避免在 Apache Flink 作业中运行初始化代码 - Avoid running initialization code in Apache Flink job when resuming from savepoint 有没有办法在执行 stream 之前以编程方式检查 Flink 流作业是否从保存点开始? - Is there a way to programmatically check if a Flink streaming job started from a savepoint before executing the stream? Apache Flink:从保存点启动作业时 AWS S3 超时异常 - Apache Flink: AWS S3 timeout exception when starting a job from a savepoint 从保存点恢复时 Flink 接收器的行为如何? - How does Flink sink behave when recovering from a savepoint?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM