Kafka 和 zookeeper docker 容器在主机上与我的 api 对话

Question

step 1:\

I've followed some steps in this guide and have created a zookeeper container and connected it to a Kafka container so they can talk to each other via local ports. I've also created a topic "foo" with 1 partition and sent 42 messages with a docker command in there. As I understand there is a Kafka port on my local os (localhost:29092) which is exposed to producing and listening to messages.

docker commands to run zookeeper container:

docker run -d --net=host --name=zookeeper -e ZOOKEEPER_CLIENT_PORT=32181 confluentinc/cp-zookeeper:4.0.0   

docker commands to run kafka container:

docker run -d --net=host --name=kafka -e KAFKA_ZOOKEEPER_CONNECT=localhost:32181 -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://localhost:29092 -e KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR=1 confluentinc/cp-kafka:4.0.0

step 2:\

Next, I'm trying to connect my Kafka producer and consumer scripts in my Springboot boot API without any docker-composing to this port as follow (I'd like to prove if these two containers are able two work as a normal Kafka distributive on my host os):

public class KafkaProducer {private static final String TOPIC = "foo";...}
public class KafkaConsumer { @KafkaListener(topics = "foo", groupId = "group1")...}

spring.kafka.producer.bootstrap-servers: localhost:29092
spring.kafka.consumer.bootstrap-servers: localhost:29092

as result, I'm getting these ERRORS:

2020-12-23 14:38:45.937  WARN 14056 --- [ntainer#0-0-C-1] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-group1-1, groupId=group1] Connection to node -1 (localhost/127.0.0.1:29092) could not be established. Broker may not be available.
2020-12-23 14:38:45.937  WARN 14056 --- [ntainer#0-0-C-1] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-group1-1, groupId=group1] Bootstrap broker localhost:29092 (id: -1 rack: null) disconnected.

Could you please tell me what I got wrong? I'm completely new to Java, Kafka, and Docker. What should I read to understand it better?

Answer 1

For some reason, it works with a new version of the guide.

https://docs.confluent.io/platform/current/quickstart/ce-docker-quickstart.html