指定 Kafka Connect 连接器插件版本

Question

How does Kafka deal with multiple versions of the same connector plugin provided in the CLASSPATH ? For example, let's say I put both mongo-kafka-1.0.0-all.jar and mongo-kafka-1.1.0-all.jar into the respective directory, in order to allow using both versions, depending on what's needed. Unfortunately, the docs do not give away a way to specify the version of connector.class , I can only assume this is dealt with like classloading is usually dealt with Java-wise.

Answer 1

If you have the same connector plugin that shares the same connector class (eg io.confluent.connect.jdbc.JdbcSinkConnector ) and you want separate versions of that same connector JAR, you would need to run multiple Kafka Connect workers.

If you have different connectors that use different dependent JARs then this is handled by Kafka Connect's classpath isolation and the plugin.path setting.