简体   繁体   English

为不同的kafka集群合并多个zookeeper

[英]Consolidating multiple zookeeper for different kafka clusters

we have 5 kafka clusters with 5 diff zk clusters (1-1 relationship).我们有 5 个 kafka 集群和 5 个 diff zk 集群(1-1 关系)。 we want to move to single zk cluster (because we end up wasting/investing too many machines just to make sure high availability of zk, 25 machines in our case).我们想转移到单个 zk 集群(因为我们最终浪费/投资了太多机器只是为了确保 zk 的高可用性,在我们的例子中是 25 台机器)。 The zkpath for all the kafka cluster are diff (otherwise there might have been some problems ).所有 kafka 集群的 zkpath 都是不同的(否则可能会出现一些问题)。 as par this and this resources it should be possible, but trying to understand if someone has tried it?作为这个这个资源的一部分,它应该是可能的,但试图了解是否有人尝试过? We don't want any kafka downtime during the switchover.我们不希望在切换期间有任何 kafka 停机时间。 Putting kafka aside if we try to merge two zk cluster what would happen?如果我们尝试合并两个 zk 集群,将 kafka 放在一边会发生什么? Will it just merge disjoint keys?它会合并不相交的键吗?

As long as you use unique chroots within the same cluster, you shouldn't experience any issues.只要您在同一集群中使用唯一的 chroot,就不会遇到任何问题。

Note: as of Kafka 3.3.x, where kraft mode is announced as production ready, you don't even need Zookeeper.注意:从 Kafka 3.3.x 开始,kraft 模式被宣布为生产就绪,您甚至不需要 Zookeeper。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 单个 zookeeper 集合上的多个 kafka 集群 - multiple kafka clusters on single zookeeper ensemble 具有多个Zookeeper配置的kafka - kafka with multiple zookeeper config 多个集群上的Kafka事务 - Kafka transactions on multiple clusters Zookeeper 是否需要用于 Apache Kafka 集群的 SSD 磁盘? - Does Zookeeper require SSD disks for Apache Kafka Clusters? 在Kafka Connect中,如何连接多个kafka集群? - In Kafka Connect, how to connect with multiple kafka clusters? Kafka Mirroring是否需要不同的动物园管理员合奏? - Does Kafka Mirroring needs different zookeeper ensemble? 使用多个分区运行Zookeeper Kafka-Java - Running Zookeeper with Multiple Partitions Kafka - Java 使用多个 Kafka 消费者集群配置 spring 启动应用程序,每个集群具有不同的 SSL 配置? - Configure spring boot app with multiple Kafka consumer clusters each with different SSL configs? 无法使用 docker 组合将 kafka 连接到具有不同端口的 zookeeper - Unable to connect kafka to zookeeper with different port using docker compose 如何将Kafka从旧Zookeeper集群迁移到具有不同znode父路径的新Zookeeper集群 - How to migrate Kafka from old Zookeeper cluster to new Zookeeper cluster with different znode parent path
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM