简体   繁体   中英

Kafka consumer stopped consuming topics from third party system

My consumers stopped consuming topics from a third party system. But They work with internal topics. The topics from the third party system appear in the kafka web view, but are not consumed.

Skipping fetch for partition because previous request to some-cluster has not been processed

I did some research and increased the heartbeat and max-poll-records, without success. See: Kafka consumer does not fetch new records when using topic pattern and large messages and Kafka Consumer stopped consuming messages from topic. We are using SmallRye Reactive Messaging connector to fetch records

How can I further debug or fix this problem

How can I further debug this problem?

I would take a look at the lowest level, ie network connectivity provided by org.apache.kafka.clients.NetworkClient . Logging that on trace level is going to show you outbound requests and received responses (or the timeouts received). This should help you identify whether it's something on your side or some kind of backend mis-configuration.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM