简体   繁体   English

如何在flink中设置kafka commitOffset?

[英]How to set kafka committedOffset in flink?

I already set committed offsetd by: 我已经设置了由以下内容抵消的提交:

properties.setProperty("auto.commit.interval.ms", "1000");
properties.setProperty("auto.commit.enable", "true");
properties.setProperty("enable.auto.commit", "true");

FlinkKafkaConsumer08<MobilePageEvent> kafkaConsumer =
            new FlinkKafkaConsumer08<>(
                    "mobile-event.page-resource", SCHEMA, properties);

But in the web UI, I get invalid committed offsets: 但是在Web UI中,我得到了无效的提交偏移量:

在此处输入图片说明

After enabling check pointing, it works now: 启用检查点之后,它现在可以工作:

StreamExecutionEnvironment environment =
            StreamExecutionEnvironment.getExecutionEnvironment();

environment.enableCheckpointing(5000);

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM