如何在创建 debezium mongodb kafka 连接器时通过 MongoDB tls 证书？

Question

We have MongoDB cluster with three replicas. I have enabled preferred TLS and authentication type as MongoDB-X509.

We have three broker strimzi kafka cluster and connect cluster with all required plugins (ie mongoDB provided by debezium) up and running.

Now I tried to create mongodb connector with following json:-

{
  "name": "mongo-connector",
  "config": {
      "connector.class": "io.debezium.connector.mongodb.MongoDbConnector", 
      "mongodb.hosts": "rs0/192.168.99.100:27017", 
      "mongodb.name": "fullfillment", 
      "collection.include.list": "inventory[.]*",
      "mongodb.ssl.enabled": "true",
      "mongodb.ssl.invalid.hostname.allowed": "true" 
     }
}

Then have executed following command to create connector:-

curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" http://192.168.99.101:8083/connectors/ -d @mongo.json

Then connectors got created, but when I am checking its status it is showing "as Failed" and connectors are not in Running state.

I was following debezium official docs for MongoDB connector, but not sure how to pass tlsCAfile and tlsCertificateKeyFile which is required for Mongo TLS connection.

Answer 1

As for Strimzi, you can use the external configuration to mount Secrets or Config Maps into the Strimzi Kafka Connect deployment: https://strimzi.io/docs/operators/latest/full/using.html#type-ExternalConfiguration-reference . Once it is loaded into the Pods, you can either just refer to it using the file path, or you can use the Kafka configuration providers to load the data into the configuration options.