How to handle Serialization error in Spring cloud stream kafka streams binder?

Question

I am writing a Kafka streams application using Spring cloud stream kafka streams binder.

While the consumer publishes message to a output topic, there may be an error like Serialization error or Network error .

In this code -

@Bean
public Function<KStream<Object, String>, KStream<Object, String>> process() {
    return (input) -> {
        KStream<Object, String> kt = input.flatMapValues(v -> Arrays.asList(v.toUpperCase().split("\\W+")));
        return kt;
    };
}

Here while producing the message back to the output topic if an error occurs, how to handle it. Is there any mechanism in Kafka streams binder other than RetryTemplate ?

Answer 1

See the Spring for Apache Kafka documentation .

When a deserializer fails to deserialize a message, Spring has no way to handle the problem, because it occurs before the poll() returns. To solve this problem, version 2.2 introduced the ErrorHandlingDeserializer2. This deserializer delegates to a real deserializer (key or value). If the delegate fails to deserialize the record content, the ErrorHandlingDeserializer2 returns a null value and a DeserializationException in a header that contains the cause and the raw bytes. When you use a record-level MessageListener, if the ConsumerRecord contains a DeserializationException header for either the key or value, the container's ErrorHandler is called with the failed ConsumerRecord. The record is not passed to the listener.