[英]Kafka Sink Connector for Cassandra failed
I'm creating Kafka Sink Conector for Cassandra via Lenses. 我正在通过镜头为Cassandra创建Kafka Sink Conector。 My configuration is:
我的配置是:
connector.class=com.datamountaineer.streamreactor.connect.cassandra.sink.CassandraSinkConnector
connect.cassandra.key.space=space1
connect.cassandra.contact.points=cassandra1
tasks.max=1
topics=demo-1206-enriched-clicks-v0.1
connect.cassandra.port=9042
connect.cassandra.kcql=INSERT INTO space1.CLicks_Test SELECT ClicksId from demo-1206-enriched-clicks-v0.1
name=test_cassandra
but, I'm getting this error: 但是,我收到了这个错误:
org.apache.kafka.common.config.ConfigException: Mandatory `topics` configuration contains topics not set in connect.cassandra.kcql: Set(demo-1206-enriched-clicks-v0.1)
at com.datamountaineer.streamreactor.connect.config.Helpers$.checkInputTopics(Helpers.scala:107)
at com.datamountaineer.streamreactor.connect.cassandra.sink.CassandraSinkConnector.start(CassandraSinkConnector.scala:65)
at org.apache.kafka.connect.runtime.WorkerConnector.doStart(WorkerConnector.java:100)
at org.apache.kafka.connect.runtime.WorkerConnector.start(WorkerConnector.java:125)
at org.apache.kafka.connect.runtime.WorkerConnector.transitionTo(WorkerConnector.java:182)
at org.apache.kafka.connect.runtime.Worker.startConnector(Worker.java:210)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:872)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.processConnectorConfigUpdates(DistributedHerder.java:324)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:296)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Any ideas why? 有什么想法吗?
Jelena, as discussed already the problem is with Kafka Connect framework not being able to parse .1
in topics=demo-1206-enriched-clicks-v0.1
. Jelena,正如已经讨论的那样,问题在于Kafka Connect框架无法在
topics=demo-1206-enriched-clicks-v0.1
解析.1
。 A bug should be reported to Kafka GitHub. 应该向Kafka GitHub报告一个错误。
@Alex what you see there is Not KSQL. @Alex你看到的不是 KSQL。 The configuration SQL we use for all our connectors is KCQL(Kafka connect query language).
我们用于所有连接器的配置SQL是KCQL(Kafka连接查询语言)。
Furthermore we have our equivalent SQL for Apache Kafka.called LSQL: http://www.landoop.com/docs/lenses/ 此外,我们有Apache Kafka.called LSQL的等效SQL: http : //www.landoop.com/docs/lenses/
This was discussed at https://launchpass.com/datamountaineers and KCQL and the Connector was verified that properly supports the .
这在https://launchpass.com/datamountaineers和KCQL中进行了讨论,并验证了连接器是否正确支持了
.
character in the KCQL configuration. KCQL配置中的字符。 The root cause, was identified to be an issue upstream in Kafka Connect framework
根本原因被确定为Kafka Connect框架中的上游问题
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.