重新分配 __consumer_offsets 主题的分区会导致问题吗？

Question

We are runnning 25 brokers. But partitions of the __consumer_offsets topic spreads on only 3 brokers and it's not fully available as we intended. This may not a problem because kafka supports reassigning partition across brokers. But we hesitate to reassign them because topic is __consumer_offsets.

Cluster information :

• Broker version: 0.11.0.2
• number of brokers : 25

__consumer_offsets topic status :

• number of partitions : 50
• number of replica : 3
• Broker spread : 3 (50 partitions are placed on 3 partitions)

My questions is : Does reassigning partitions of __consumer_offsets topic leads problem or not?

Answer 1

您可以重新分配 __consumer_offset 的分区，不会有任何问题，因为它的重新分配与其他主题的处理方式相同

Answer 2

Currently, we are using Kafka 2.11-1.1.1. I had a problem with reassigning some partitions of consumer_offset. it caused a rolling restart of all Kafka instances due to this exception in fetcher thread.

kafka.common.OffsetsOutOfOrderException: Out of order offsets found in append to __consumer_offsets-31.

I don't know why but I think we should do it in silence time.