How to get consumer-id using a @KafkaListener spring boot 2 consumer

Question

bin/kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group my-consumer

Is it possible to get consumer-id information like in above command output in a Spring boot @KafkaListener consumer ?
I want to add this the consumer-id to a table to represent a processor that processed data.
I have gone through @gary-russell's answer on How to get kafka consumer-id for logging , But I dont see consumer-id appearing in partitions assigned logs.

[org.springframework.kafka.KafkaListenerEndpointContainer#0-0-C-1] INFO  o.s.k.l.KafkaMessageListenerContainer.info - my-consumer: partitions assigned: [test_topic-7, test_topic-6, test_topic-5, test_topic-4]
[org.springframework.kafka.KafkaListenerEndpointContainer#1-0-C-1] INFO  o.s.k.l.KafkaMessageListenerContainer.info - my-consumer: partitions assigned: [test_topic-3, test_topic-2, test_topic-1, test_topic-0]

I am using spring boot 2.2.2
dependencies: spring-kafka

Answer 1

You might want to use the following chain of methods using autowired AdminClient :

public Collection<MemberDescription> members() 
    throws InterruptedException, ExecutionException, TimeoutException 
{
  String group = "my-consumer";
  List<String> groups = Collections.singletonList(group);

  return adminClient
    .describeConsumerGroups(groups) // DescribeConsumerGroupsResult
    .describedGroups()              // Map<String, KafkaFuture<ConsumerGroupDescription>>
    .get(group)                     // KafkaFuture<ConsumerGroupDescription>
    .get(2, TimeUnit.SECONDS)       // ConsumerGroupDescription
    .members();                     // Collection<MemberDescription>
}

The returned collection of the MemberDescription contains your consumers. The object provides the following "getters":

• MemberDescription::clientId with the CLIENT-ID entries.
• MemberDescription::consumerId with the COMSUMER-ID entries.

The reason behind KafkaFuture wrapping is to support the asynchronous programming style in the Java-8 way implementing java.util.concurrent.Future<T> . You can either block a call with a hope for the result (should be available that time) using ( .get(2, TimeUnit.SECONDS) ) or use the proper asynchronous way through Java-8 Futures.

Answer 2

I don't think the consumer-id is available on the client; you can get the client-id s from the metrics :

@SpringBootApplication
public class So61616543Application {

    public static void main(String[] args) {
        SpringApplication.run(So61616543Application.class, args).close();
    }


    @KafkaListener(id = "so61616543", topics = "so61616543")
    public void listen(String in) {
        System.out.println(in);
    }

    @Bean
    public NewTopic topic() {
        return TopicBuilder.name("so61616543").partitions(1).replicas(1).build();
    }


    @Bean
    public ApplicationRunner runner(KafkaListenerEndpointRegistry registry) {
        return args -> {
            registry.getListenerContainer("so61616543").metrics()
                .forEach((clientId, metrics) -> {
                    System.out.println(clientId);
                    metrics.forEach((key, value) -> System.out.println(key + ":" + value));
                });
        };
    }

}