Kafka 消费者停止从第三方系统消费主题

Question

My consumers stopped consuming topics from a third party system. But They work with internal topics. The topics from the third party system appear in the kafka web view, but are not consumed.

Skipping fetch for partition because previous request to some-cluster has not been processed

I did some research and increased the heartbeat and max-poll-records, without success. See: Kafka consumer does not fetch new records when using topic pattern and large messages and Kafka Consumer stopped consuming messages from topic. We are using SmallRye Reactive Messaging connector to fetch records

How can I further debug or fix this problem

Answer 1

How can I further debug this problem?

I would take a look at the lowest level, ie network connectivity provided by org.apache.kafka.clients.NetworkClient . Logging that on trace level is going to show you outbound requests and received responses (or the timeouts received). This should help you identify whether it's something on your side or some kind of backend mis-configuration.