Kafka Connect接收器“直通”连接器

Question

Does the kafka jdbc sink connector support writing what it consumes to a different topic. I am looking for a passthrough mechanism and illustrated below. If it does not, I could chain a sink and the source (reading from where the sink wrote) but do not think that will be as performant. Perhaps I could modify the existing sink connector to accomplish this?

Topic 1 -> Sink Connector ->  Topic 2
               |
               V
               DB

Answer 1

The Connect Framework allows writing to a Dead-Letter Queue topic for error-causing records, but there is no such tee -like feature in Connect.

If you want a source reading from what a sink wrote, then you would have two connectors.

For example,

JDBC_Sink -> DB -> Debezium -> Topic

Answer 2

我建议编写一个简单的Kafka Streams应用程序，将从主题1到主题2的所有内容转发。并按原样使用连接器将主题1中的内容接收到DB中。