[英]How To Convert List Object to JavaDStream Spark?
i have List object bellow: 我有List对象:
List<Tuple2<Tuple3<String, Long, Object>, Tuple2<Long, Object[]>>> rddQueue =
Arrays.asList(tupleList);
how can convert its to JavaDStream Spark ? 如何将其转换为JavaDStream Spark? thank advance !
谢谢提前!
You can do that using the JavaStreamingContext
and a Queue<T>
: 你可以使用
JavaStreamingContext
和Queue<T>
来做到这一点:
List<Tuple2<Tuple3<String, Long, Object>, Tuple2<Long, Object[]>>>
list = Arrays.asList();
// Random batch time, for the sake of the example.
JavaStreamingContext jssc =
new JavaStreamingContext("local[*]", "TestApp", new Duration(4000));
Queue<JavaRDD<Tuple2<Tuple3<String, Long, Object>, Tuple2<Long, Object[]>>>> rddQueue =
new LinkedList<>();
rddQueue.add(jssc.sparkContext().parallelize(list));
JavaDStream<Tuple2<Tuple3<String, Long, Object>, Tuple2<Long, Object[]>>> dStream =
jssc.queueStream(rddQueue);
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.