Spring Kafka获得分配的分区

Question

我知道我可以从哪个分区记录中找到，但我想知道有什么方法可以动态地获取在特定时刻为消费者分配的分区吗？ 也许我需要实现一些侦听器来检测并跟进分区分配信息？

我使用spring-kafka 1.3.2与ConcurrentKafkaListenerContainerFactory和@KafkaListener 。

Answer 1

是的，你可以这样做：

@Bean
public ConsumerAwareRebalanceListener rebalanceListener() {
    return new ConsumerAwareRebalanceListener() { 
        @Override
        public void onPartitionsAssigned(Consumer<?, ?> consumer, Collection<TopicPartition> partitions) {
           // here partitions
        }
    };
}

然后将它添加到ConcurrentKafkaListenerContainerFactory中

@Bean
public ConcurrentKafkaListenerContainerFactory<Object, Object> kafkaListenerContainerFactory() {
    ConcurrentKafkaListenerContainerFactory<Object, Object> factory = new ConcurrentKafkaListenerContainerFactory<>();

    ContainerProperties props = factory.getContainerProperties();
    props.setConsumerRebalanceListener(rebalanceListener());

    return factory;
}

Answer 2

我通过使用KafkaListenerEndpointRegistry以不同的方式完成了KafkaListenerEndpointRegistry

for (MessageListenerContainer messageListenerContainer : kafkaListenerEndpointRegistry.getListenerContainers()) {
            List<KafkaMessageListenerContainer> containers = ((ConcurrentMessageListenerContainer) messageListenerContainer).getContainers();

            List<TopicPartition> topicPartitions = (List<TopicPartition>) containers.stream().flatMap(kafkaMessageListenerContainer ->
                            kafkaMessageListenerContainer.getAssignedPartitions().stream()).collect(Collectors.toList());

            partitions.addAll(topicPartitions.stream().map(TopicPartition::partition).collect(Collectors.toList()));
}