简体   繁体   English

卡夫卡一消费一分区

[英]Kafka one consumer one partition

I have a use case where I have a single topic with 100 partitions where messages go in each partition with some logic and I have 100 consumers who reads this message. 我有一个用例,其中我有一个带有100个分区的主题,其中消息以某种逻辑进入每个分区,并且我有100个使用者读取此消息。 I want to map a specific partition to a specific consumer. 我想将特定分区映射到特定使用者。 How can I achieve that? 我该如何实现?

Checkout the Javadoc for the KafkaConsumer, specifically the section "Manual Partition Assignment". 检出KafkaConsumer的Javadoc ,特别是“手动分区分配”部分。

TL/DR TL / DR

You can manually assign specific partitions to a consumer as follows: 您可以手动将特定的分区分配给使用者,如下所示:

String topic = "foo";
TopicPartition partition0 = new TopicPartition(topic, 0);
TopicPartition partition1 = new TopicPartition(topic, 1);
consumer.assign(Arrays.asList(partition0, partition1));

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM