[英]Write PairDStram to cassandra using Datastax Spark Cassandra Connector
I need to write data of my filtered stream to cassandra using Java and Datastax Spark Cassandra Connector. 我需要使用Java和Datastax Spark Cassandra Connector将我的过滤流的数据写入cassandra。
I followed the datastax java documentation . 我按照datastax java文档 。
The documentation explains how to write a RDD to cassandra, but not how to write a Dstream. 该文档解释了如何将编写RDD写入cassandra,而不是如何编写Dstream。
I need to be able to save a PairDStream and I don't know how to do it, because all examples are written in scala. 我需要能够保存一个PairDStream,我不知道该怎么做,因为所有的例子都是用scala编写的。
I need to turn the following code written in scala in the java's code: 我需要在java的代码中转换以scala编写的代码:
val wc = stream.flatMap(_.split("\\s+"))
.map(x => (x, 1))
.reduceByKey(_ + _)
.saveToCassandra("streaming_test", "words", SomeColumns("word", "count"))
Basically I have to save a JavaPairDStream<String, Integer>
基本上我必须保存JavaPairDStream<String, Integer>
Solution, in case anyone looking for the answer 解决方案,以防任何人寻找答案
To write a DStream or JavaDStream to Cassandra, need to import: 要将DStream或JavaDStream写入Cassandra,需要导入:
import static com.datastax.spark.connector.japi.CassandraStreamingJavaUtil.*;
and use javaFunctions(DStream<T> arg0)
or javaFunctions(JavaDStream<T> arg0)
并使用javaFunctions(DStream<T> arg0)
或javaFunctions(JavaDStream<T> arg0)
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.