简体   繁体   中英

Export data from Kafka to Oracle

I am trying to export data from Kafka to Oracle db. I've searched related questions and web but could not understand that we need a platform (confluent etc.. ) or not. I'd been read the link below but it's not clear enough.
https://docs.confluent.io/3.2.2/connect/connect-jdbc/docs/sink_connector.html
So, what we actually need to export data without 3rd party platform?

Thanks in advance.

It's not clear what you mean by "third-party" here

What you linked to is Kafka Connect , which is Apache 2.0 Licensed and open source.

Kafka Connect is a plugin ecosystem, you install connectors individually, written by anyone, or write your own, just like any other Java dependency (ie a third-party)

The JDBC connector just happens to be maintained by Confluent. and you can configure the Confluent Hub CLI to install within any Kafka Connect distribution (or use Kafka Connect Docker images from Confluent)


Alternatively, you use Apache Spark, Flink, Nifi, and many other Kafka Consumer libraries to read data and then start an Oracle transaction per record batch

Or you can explore non-JVM kafka libraries as well and use a language you're more familiar with doing Oracle operations with

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM