Apache Kafka Connect VS Confluent 连接器

Question

使用 Apache Kafka Connect API 和 Confluent Kafka Connect API 有什么区别？

Answer 1

As mike mentioned, there is no core difference between Apache kafka connect and confluent kafka connect.

---

As an example of using JDBC Connector plugin from Confluent with MySQL database to read data from MySQL and send it to kafka topic.

For a quick demo on your laptop, follow below main steps:

1. Download Apache Kafka (from either Apache site, or you can download Confluent Platform)
2. Run single Kafka broker using kafka-server-start script.
3. Download kafka-connect-jdbc from Confluent Hub
4. Edit plugin.path in connect-standalone.properties to include the full path to extracted kafka-connect-jdbc files.
5. Download and copy mysql driver into kafka-connect-jdbc folder with other JARs (you should see sqlite JAR is already there)
6. create jdbc source connector configuration file
7. run Kafka connect in standalone mode with jdbc source connector configuration

$KAFKA_HOME/bin/connect-standalone.sh ../config/connect-standalone.properties ../config/jdbc-connector-config.properties

Useful links

https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/ https://docs.confluent.io/current/connect/kafka-connect-jdbc/index.html

If you want to write code, then learn kafka producer api usage. https://docs.confluent.io/current/clients/producer.html https://kafka.apache.org/documentation/#producerapi