创建主题失败","异常":"\norg.apache.kafka.common.errors.UnsupportedVersionException

Question

{
   "mdc":{
      
   },
   "timestamp":"2021-05-11 11:48:04.055",
   "level":"ERROR",
   "logger":"org.springframework.cloud.stream.binder.kafka.provisioning.KafkaTopicProvisioner",
   "message":"Failed to create topics",
   "exception":"\"\norg.apache.kafka.common.errors.UnsupportedVersionException: Creating topics with default partitions/replication factor are only supported in CreateTopicRequest version 4+. The following topics need values for partitions and replicas:"

Please suggest what changes are required as i am getting this error.

Answer 1

I see you are new here. You should always include version information and full stack trace for questions like this.

Upgrade your broker to >= 2.4 or set the binder replication factor property.

See https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/commit/4161f875ede0446ab1d485730c51e6a2c5baa37a

• Change default replication factor to -1

Binder now uses a default value of -1 for replication factor signaling the broker to use defaults. Users who are on Kafka brokers older than 2.4, need to set this to the previous default value of 1 used in the binder.

In either case, if there is an admin policy that requires replication factor > 1, then that value must be used instead.

Answer 2

Overriding the default replication factor(-1) with a non negative value fixed the issue for me.

spring.cloud.stream.kafka.binder.replication-factor=1

For application.yaml file use:

spring.cloud.stream.kafka.binder.replicationFactor: 1