无法从另一个 docker 容器连接到 kafka docker 容器

Question

我正在尝试从另一个 docker 容器连接到 kafka docker 容器。 但它没有连接。

有用于 kafka 消息传递的容器列表

网络kafka-docker_default有两个容器kafka-docker_zookeeper_1和kafka-docker_kafka0_1

为了运行 kafka 和 zookeeper，我使用了 docker-compose 文件：

version: '2'
services:
  zookeeper:
    image: "confluentinc/cp-zookeeper:latest"
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000

# This has three listeners you can experiment with. 
# BOB for internal traffic on the Docker network
# FRED for traffic from the Docker-host machine (`localhost`)
# ALICE for traffic from outside, reaching the Docker host on the DNS name `never-gonna-give-you-up`
# Use 
  kafka0:
    image: "confluentinc/cp-kafka"
    ports:
      - '9092:9092'
      - '29094:29094'
    depends_on:
      - zookeeper
    environment:
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
      KAFKA_LISTENERS: LISTENER_BOB://kafka0:29092,LISTENER_FRED://kafka0:9092,LISTENER_ALICE://kafka0:29094
      KAFKA_ADVERTISED_LISTENERS: LISTENER_BOB://kafka0:29092,LISTENER_FRED://localhost:9092,LISTENER_ALICE://never-gonna-give-you-up:29094
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: LISTENER_BOB:PLAINTEXT,LISTENER_FRED:PLAINTEXT,LISTENER_ALICE:PLAINTEXT
      KAFKA_INTER_BROKER_LISTENER_NAME: LISTENER_BOB
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1

容器dockercompose17138956372294708100_kafkatest.producer_1和dockercompose17138956372294708100_kafkatest.consumer_1用于生产和消费消息。 当容器dockercompose17138956372294708100_kafkatest.producer_1尝试使用 bootstrap.servers 参数（localhost:9092 或 never-gonna-give-you-up:29094）连接到 kafka 集群时，它显示错误

%7|1569945335.015|BROKERFAIL|rdkafka#producer-1| [thrd:never-gonna-give-you-up:29094/bootstrap]: never-gonna-give-you-up:29094/bootstrap: failed: err: Local: Host resolution failure: (errno: Bad address)
%3|1569945335.015|FAIL|rdkafka#producer-1| [thrd:never-gonna-give-you-up:29094/bootstrap]: never-gonna-give-you-up:29094/bootstrap: Failed to resolve 'never-gonna-give-you-up:29094': Name or service not known (after 1656ms in state CONNECT)
%3|1569945335.015|ERROR|rdkafka#producer-1| [thrd:never-gonna-give-you-up:29094/bootstrap]: never-gonna-give-you-up:29094/bootstrap: Failed to resolve 'never-gonna-give-you-up:29094': Name or service not known (after 1656ms in state CONNECT)
%7|1569945335.015|STATE|rdkafka#producer-1| [thrd:never-gonna-give-you-up:29094/bootstrap]: never-gonna-give-you-up:29094/bootstrap: Broker changed state CONNECT -> DOWN
%3|1569945335.015|ERROR|rdkafka#producer-1| [thrd:never-gonna-give-you-up:29094/bootstrap]: 1/1 brokers are down

我该如何解决？

Answer 1

dockercompose17138956372294708100_kafkatest.producer_1 正在尝试使用bootstrap.servers参数（ localhost:9092或never-gonna-give-you-up:29094 ）连接到 kafka 集群

从另一个 Docker 容器中，这些都不正确。

1. 在您的 Docker 配置中， never-gonna-give-you-up在任何地方都不存在作为主机名/DNS 记录。 根据错误，您的外部 DNS 服务器也不知道那是什么

2. localhost指的是 Kafka 客户端容器，而不是您的主机或代理容器。

根据您的 compose 配置，您需要连接到kafka0主机/服务，它在bootstrap.servers的端口29092上公布

# BOB for internal traffic on the Docker network
KAFKA_ADVERTISED_LISTENERS: LISTENER_BOB://kafka0:29092

您还应该删除 LISTENER_ALICE 因为它没有提供任何有用的连接详细信息，除非您的主机的外部主机名实际上是never-gonna-give-you-up

你会想把你的生产者和消费者作为你的撰写文件的一部分

Answer 2

请尝试以下配置：

version: '3'
services:
  zookeeper:
    image: confluentinc/cp-zookeeper:latest
    ports:
      - "32181:32181"
    environment:
      ZOOKEEPER_CLIENT_PORT: 32181
      ZOOKEEPER_TICK_TIME: 2000

  kafka0:
    image: confluentinc/cp-kafka:latest
    ports:
     - "9090:9090"
    depends_on:
      - zookeeper
    environment:
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:32181
      KAFKA_ADVERTISED_LISTENERS: LISTENER_INTERNAL://kafka0:29090,LISTENER_EXTERNAL://localhost:9090
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: LISTENER_INTERNAL:PLAINTEXT,LISTENER_EXTERNAL:PLAINTEXT
      KAFKA_INTER_BROKER_LISTENER_NAME: LISTENER_INTERNAL
      KAFKA_AUTO_CREATE_TOPICS_ENABLE: "false"

使用此配置，如果您从主机连接到代理的容器，则使用 IP localhost:9090 。 如果您从具有相同网络的其他容器连接，则使用kafka0:29090 。