[英]Kafka JDBC Source connector: create topics from column values
I have a microservice that uses OracleDB to publish the system changes in the EVENT_STORE
table.我有一个微服务,它使用 OracleDB 在
EVENT_STORE
表中发布系统更改。 The table EVENT_STORE
contains a column TYPE
with the name of the type of the event.表
EVENT_STORE
包含一个列TYPE
,其中包含事件类型的名称。
It is possible that JDBC Source Kafka Connect take the EVENT_STORE
table changes and publish them with the value of column TYPE
in the KAFKA-TOPIC? JDBC Source Kafka Connect 是否有可能采用
EVENT_STORE
表更改并使用 KAFKA-TOPIC 中列TYPE
的值发布它们?
It is my source kafka connector config:这是我的源 kafka 连接器配置:
{
"name": "kafka-connector-source-ms-name",
"config": {
"connector.class": "io.confluent.connect.jdbc.JdbcSourceConnector",
"tasks.max": "1",
"connection.url": "jdbc:oracle:thin:@localhost:1521:xe",
"connection.user": "squeme-name",
"connection.password": "password",
"topic.prefix": "",
"table.whitelist": "EVENT_STORE",
"mode": "timestamp+incrementing",
"timestamp.column.name": "CREATE_AT",
"incrementing.column.name": "ID",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"value.converter": "org.apache.kafka.connect.json.JsonConverter",
"config.action.reload": "restart",
"errors.retry.timeout": "0",
"errors.retry.delay.max.ms": "60000",
"errors.tolerance": "none",
"errors.log.enable": "false",
"errors.log.include.messages": "false",
"connection.attempts": "3",
"connection.backoff.ms": "10000",
"numeric.precision.mapping": "false",
"validate.non.null": "true",
"quote.sql.identifiers": "ALWAYS",
"table.types": "TABLE",
"poll.interval.ms": "5000",
"batch.max.rows": "100",
"table.poll.interval.ms": "60000",
"timestamp.delay.interval.ms": "0",
"db.timezone": "UTC"
}
}
You can try the ExtractTopic transform to pull a topic name from a field您可以尝试使用ExtractTopic转换从字段中提取主题名称
Add the following properties to the JSON将以下属性添加到 JSON
transforms=ValueFieldExample
transforms.ValueFieldExample.type=io.confluent.connect.transforms.ExtractTopic$Value
transforms.ValueFieldExample.field=TYPE
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.