如何使用单个kafka命令列出所有组中的所有主题以及每个主题中的消息总数？

Question

I'm trying to list all topics from all group ids with total number of messages in each topic but couldn't find such command anywhere. Tried the below 2 commands but expecting the results of the below commands in a single command. Please help.

Command 1:(To list all topics in Kafka server)

bin/kafka-topics.sh --list --zookeeper localhost:2181

Command 2:(To know the count of total messages in a topic in Kafka server)

bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list 0.0.0.0:6667 --topic topicname --time -1

Answer 1

I have never heard of a kafka command that can do what you want. However, you can achieve this with basic shell scripting. This command should do the job :

./bin/kafka-topics.sh --zookeeper localhost:2181 --list | while read x; do ./bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9092 --topic $x --time -1; done

Tested with kafka 0.10.2 running on Linux.