简体   繁体   English

Kafka JDBC Sink连接器-Oracle

[英]Kafka JDBC Sink Connector - Oracle

I am creating jdbc sink connector(confluent) to oracle, first time. 我第一次创建到Oracle的jdbc接收器连接器(合流)。 Below is the connector config. 下面是连接器配置。 It is not creating and loading the table, but offset is being increased as per log and no error thrown in the log. 它不是在创建和加载表,而是根据日志增加偏移量,并且日志中不会引发任何错误。 Please suggest what could be the issue. 请提出可能是什么问题。

Producing through java, 5 sample records. 通过java制作的5个示例记录。 I have tried curl to check the status, it is running. 我试过curl来检查状态,它正在运行。

{
    "name": "ora_sink_task",
    "config": {
            "connector.class": "io.confluent.connect.jdbc.JdbcSinkConnector",
            "connection.url": "jdbc:oracle:thin:@host:port/servicename",
            "connection.user": "user",
            "connection.password": "password",
            "topics": "connecttest",
            "tasks.max": "1",
            "table.name.format": "member_cbdt_sink1",
            "value.converter":"io.confluent.connect.avro.AvroConverter",
            "value.converter.schema.registry.url":"http://localhost:8081",
            "auto.create": "true"
            }
}

Connector log: 连接器日志:

[2019-09-09 00:34:23,832] INFO Checking Oracle dialect for existence of table "member_cbdt_sink1" (io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:492) [2019-09-09 00:34:23,834] INFO Using Oracle dialect table "member_cbdt_sink1" absent (io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:500) [2019-09-09 00:34:23,846] INFO Checking Oracle dialect for existence of table "member_cbdt_sink1" (io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:492) [2019-09-09 00:34:23,849] INFO Using Oracle dialect table "member_cbdt_sink1" present (io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:500) [2019-09-09 00:34:24,037] INFO Setting metadata for table "member_cbdt_sink1" to Table{name='"member_cbdt_sink1"', columns=[Column{'first_name', isPrimaryKey=false, allowsNull=false, sqlType=CLOB}, Column{'height', isPrimaryKey=false, allowsNull=false, sqlType=BINARY_FLOAT}, Column{'last_name', isPrimaryKey=false, allowsNull=false, sqlType=CLOB}, Column{'age', isPrimaryKey=false, al [2019-09-09 00:34:23,832]信息检查Oracle方言中是否存在表“ member_cbdt_sink1”(io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:492)[2019-09-09 00:34:23,834] INFO不使用Oracle方言表“ member_cbdt_sink1”(io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:500)[2019-09-09 00:34:23,846] INFO检查Oracle方言中是否存在表“ member_cbdt_sink1”(io。 confluent.connect.jdbc.dialect.OracleDatabaseDialect:492)[2019-09-09 00:34:23,849]信息使用Oracle方言表“ member_cbdt_sink1”存在(io.confluent.connect.jdbc.dialect.OracleDatabaseDialect:500)[2019年-09-09 00:34:24,037]信息将表“ member_cbdt_sink1”的元数据设置为表{name ='“ member_cbdt_sink1”',column = [Column {'first_name',isPrimaryKey = false,allowNull = false,sqlType = CLOB} ,Column {'height',isPrimaryKey = false,allowsNull = false,sqlType = BINARY_FLOAT},Column {'last_name',isPrimaryKey = false,allowsNull = false,sqlType = CLOB},Column {'age',isPrimaryKey = false,al lowsNull=false, sqlType=NUMBER}, Column{'automated_email', isPrimaryKey=false, allowsNull=true, sqlType=NUMBER}, Column{'weight', isPrimaryKey=false, allowsNull=false, sqlType=BINARY_FLOAT}]} (io.confluent.connect.jdbc.util.TableDefinitions:65) [2019-09-09 00:35:13,775] INFO WorkerSinkTask{id=ora_sink_task-0} Committing offsets asynchronously using sequence number 1: {connecttest-0=OffsetAndMetadata{offset=55, metadata=''}} (org.apache.kafka.connect.runtime.WorkerSinkTask:345) [2019-09-09 01:03:13,775] INFO WorkerSinkTask{id=ora_sink_task-0} Committing offsets asynchronously using sequence number 29: {connecttest-0=OffsetAndMetadata{offset=60, metadata=''}} (org.apache.kafka.connect.runtime.WorkerSinkTask:345) lowsNull = false,sqlType = NUM​​BER},列{'automated_email',isPrimaryKey = false,allowsNull = true,sqlType = NUM​​BER},Column {'weight',isPrimaryKey = false,allowsNull = false,sqlType = BINARY_FLOAT}]}(io .confluent.connect.jdbc.util.TableDefinitions:65)[2019-09-09 00:35:13,775] INFO WorkerSinkTask {id = ora_sink_task-0}使用序列号1异步提交偏移量:{connecttest-0 = OffsetAndMetadata {offset = 55,元数据=''}}(org.apache.kafka.connect.runtime.WorkerSinkTask:345)[2019-09-09 01:03:13,775] INFO WorkerSinkTask {id = ora_sink_task-0}使用序列异步提交偏移量数字29:{connecttest-0 = OffsetAndMetadata {offset = 60,元数据=“''}}(org.apache.kafka.connect.runtime.WorkerSinkTask:345)

当Oracle查找大写字母时,它通过将table.name.format的值从小写更改为大写来工作。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 使用Kafka Connect API JDBC Sink Connector示例的Oracle数据库的Kafka主题 - Kafka Topic to Oracle database using Kafka Connect API JDBC Sink Connector Example 在 Oracle 数据库中插入/更新数据时,JDBC Kafka Sink 连接器是否支持 Oracle 分区? - Does the JDBC Kafka Sink connector support Oracle partitioning when inserting / updating data in an Oracle database? Flink Oracle JDBC sink 连接器未加载驱动程序 - Flink Oracle JDBC sink connector not loading the driver 使用 Solace Source Connector 和 JDBC SInk Connector 的 Kafka Connect 问题 - Issue with Kafka Connect with Solace Source Connector and JDBC SInk Connector Kafka Connect-JDBC连接器-Oracle数据库 - Kafka Connect - JDBC Connector - Oracle Database 卡夫卡 Cassandra 接收器连接器中的 ClassCastException - ClassCastException in kafka Cassandra sink connector 在使用Kafka connect jdbc sink插入Oracle表之前,如何将CLOB数据转换为VARCHAR2? - How to convert CLOB data to VARCHAR2 before inserting to Oracle table using Kafka connect jdbc sink? Spark Streaming Oracle JDBC 带钱包的接收器 - Spark Streaming Oracle JDBC sink with wallet 如何使用 JDBC 接收器连接器将表名转换为大写 - How to convert table name to uppercase using JDBC sink connector 如何使用kafka connect将kafka主题下沉到oracle? - How to sink kafka topic to oracle using kafka connect?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM