spring cloud stream kafka binder 以编程方式将 kafka 主题（多个分区）偏移量重置为任意数字

Question

I have a requirement to reset offset to a number.

Detailed requirement : My application is consuming messages from kafka topic and dumping it in DB, let's say DB goes down while processing the consumed messages(offset=10) and till the time DB was down the application consumed messages till offset 20.

Now DB comes up again while processing the 20th offset message, now I want to reset the offset to 10 again so that I can save the data in database.

Can I achieve that programatically (spring boot) ? I am using spring cloud stream binder kafka.

Answer 1

Why continue to receive messages if the DB is down?

Simply configure the listener container to keep retrying the current record until the DB is available again.

@Bean
ListenerContainerCustomizer<AbstractMessageListenerContainer<?, ?>> listenerContainerCustomizer() {
    return (container, topic, group) -> {
        container.setErrorHandler(...);
    };
}

See https://docs.spring.io/spring-kafka/docs/current/reference/html/#seek-to-current