Can I have different kafka topic with different amount of partitions within the same consumer group? If so, can I scale the consumers to the number of the topic with the most partitions? Thanks
Yes, each topic can independently have any number of partitions. I'm assuming you are consuming multiple topics with the same consumer, in any case, what will happen is that the topics that have fewer partitions than consumers will be consumed by a subset of the consumers (some consumers will not get any messages from these topics since they won't have any partition assigned)
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.