将消息从一个 Kafka 主题“推送”到另一个主题
[英]“Pushing” Messages From One Kafka Topic To Another
问题描述
So, I have been tasked with setting up a kafka to kafka streaming service, whereby my company will send kafka messages from our topics, to a customers kafka topic.
因此，我的任务是设置 kafka 到 kafka 流媒体服务，我的公司将通过该服务将 kafka 消息从我们的主题发送到客户的 kafka 主题。
What would be the best tool for this job?这项工作的最佳工具是什么？
1 个解决方案
解决方案1
0 2021-07-17 16:12:37
If you are looking for replication then you should be looking at mirror maker.如果您正在寻找复制，那么您应该查看镜像制造商。 https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0 https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0
If you don't control the source of destination end point then you might need to do more with access control.如果您不控制目标端点的源，那么您可能需要对访问控制做更多的事情。 The question is a little under specified, but in any case looking at what mirror maker does and how it works is a good starting point.这个问题有点不明确，但无论如何，看看镜子制造商做什么以及它是如何工作的，这是一个很好的起点。
If you need something more comprehensive that will work with sources or destinations that are not Kafka then this is something you might want to look at.如果您需要更全面的东西来处理非 Kafka 的源或目的地，那么这就是您可能想要查看的东西。 https://github.com/linkedin/brooklin https://github.com/linkedin/brooklin
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.