简体繁体 English

Debezium Kafka连接器mongodb

[英]Debezium Kafka connector mongodb

原文 2019-02-28 14:51:16 6 1 mongodb/ apache-kafka/ apache-kafka-connect/ debezium

Is there any way to specify to kafka connector which actions on mongo should consider. 有什么方法可以指定给kafka连接器，在mongo上应该考虑哪些操作。 Actually, I don't want that kafka does anything when a mongo document is deleted (just update and insert new doc should be considered). 实际上，删除mongo文档时，我不希望kafka做任何事情（仅应考虑更新并插入新文档）。
Thank you 谢谢

1 个解决方案

you can write a SMT ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-66%3A+Single+Message+Transforms+for+Kafka+Connect ) that can filter out unwanted operations. 您可以编写一个SMT（ https://cwiki.apache.org/confluence/display/KAFKA/KIP-66%3A+Single+Message+Transforms+for+Kafka+Connect ）来过滤掉不需要的操作。 An example is of dropping a delete record is en excerpt from this SMT - https://github.com/debezium/debezium-examples/blob/master/outbox/event-routing-smt/src/main/java/io/debezium/examples/outbox/routingsmt/EventRouter.java#L44 从此SMT中摘录的一个示例是delete记录-https: //github.com/debezium/debezium-examples/blob/master/outbox/event-routing-smt/src/main/java/io/debezium /examples/outbox/routingsmt/EventRouter.java#L44

Debezium mongodb kafka 连接器没有像 mongodb 那样在主题中产生一些记录 - Debezium mongodb kafka connector not producing some of records in topic as it is in mongodb

在远程 MSK kafka 集群上使用 kafka 连接 mongoDB debezium 源连接器 - use kafka connect mongoDB debezium souce connector on a remote MSK kafka cluster

如何在创建 debezium mongodb kafka 连接器时通过 MongoDB tls 证书？ - how to pass MongoDB tls certificates while creating debezium mongodb kafka connector?

我们如何从具有debezium kafka连接器的副本集中的辅助mongodb节点中截取oplog？ - How could we tail oplog from a secondary mongodb node in a replica set with debezium kafka connector?

Debezium MongoDB 连接器错误：org.apache.kafka.connect.errors.ConnectException：错误处理程序中超出容差 - Debezium MongoDB Connector Error: org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler

kafka 连接器 debezium mongodb CDC 更新/$set 消息没有过滤器（_id 值） - kafka connector debezium mongodb CDC update/$set message without filter(_id value)

如何使用 Debezium MongoDB 源连接器将 JSON 值转换为 Kafka 消息密钥？ - How to transform JSON value to Kafka message key with Debezium MongoDB Source Connector?

Mongodb 到 Kafka 连接器 - Mongodb to Kafka Connector

通过debezium mongodb连接器连接到mongodb时身份验证失败 - Authentication failed when connected to mongodb by debezium mongodb connector

kafka mongodb接收器连接器未启动 - kafka mongodb sink connector not starting

暂无

暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 Debezium mongodb kafka 连接器没有像 mongodb 那样在主题中产生一些记录 - Debezium mongodb kafka connector not producing some of records in topic as it is in mongodb 在远程 MSK kafka 集群上使用 kafka 连接 mongoDB debezium 源连接器 - use kafka connect mongoDB debezium souce connector on a remote MSK kafka cluster 如何在创建 debezium mongodb kafka 连接器时通过 MongoDB tls 证书？ - how to pass MongoDB tls certificates while creating debezium mongodb kafka connector? 我们如何从具有debezium kafka连接器的副本集中的辅助mongodb节点中截取oplog？ - How could we tail oplog from a secondary mongodb node in a replica set with debezium kafka connector? Debezium MongoDB 连接器错误：org.apache.kafka.connect.errors.ConnectException：错误处理程序中超出容差 - Debezium MongoDB Connector Error: org.apache.kafka.connect.errors.ConnectException: Tolerance exceeded in error handler kafka 连接器 debezium mongodb CDC 更新/$set 消息没有过滤器（_id 值） - kafka connector debezium mongodb CDC update/$set message without filter(_id value) 如何使用 Debezium MongoDB 源连接器将 JSON 值转换为 Kafka 消息密钥？ - How to transform JSON value to Kafka message key with Debezium MongoDB Source Connector? Mongodb 到 Kafka 连接器 - Mongodb to Kafka Connector 通过debezium mongodb连接器连接到mongodb时身份验证失败 - Authentication failed when connected to mongodb by debezium mongodb connector kafka mongodb接收器连接器未启动 - kafka mongodb sink connector not starting

相关标签

粤ICP备18138465号 © 2020-2024 STACKOOM.COM