flink 作业有时通过 sql-client.sh 提交，没有任何检查点（改变它的方法是什么）或在失败的情况下如何恢复

Question

for example sql-client.sh embedded insert into wap_fileused_daily(orgId, pdate, platform, platform_count) select u.orgId, u.pdate, coalesce(p.platform,'other'), sum(u.isMessage) as platform_count from users as u left join ua_map_platform as p on u.uaType = p.uatype where u.isMessage = 1 group by u.orgId, u.pdate, p.platform

it will show up as: enter image description here

there will never be any checkpoint. Question: 1) how to trigger checkpoint ( alert job) 2) how to recover in case of failure

Answer 1

You can specify execution configuration parameters in the SQL Client YAML file. For example, the following should work:

configuration:
  execution.checkpointing.interval: 42

Answer 2

There is a feature request on flink: https://cwiki.apache.org/confluence/display/FLINK/FLIP-147%3A+Support+Checkpoints+After+Tasks+Finished