简体   繁体   English

Spark Flatmap-将Scala转换为Java代码

[英]spark flatmap - scala to java code

I have been practising spark. 我一直在练习火花。 I am not very familiar with scala and want to try the java code. 我对scala不太熟悉,想尝试Java代码。 For the below basic operations of map and flatmap, how do i write the below code in java 对于下面的map和flatmap基本操作,如何在Java中编写以下代码

sc.parallelize(List(1,2,3)).flatMap(x=>List(x,x,x)).collect
sc.parallelize(List(1,2,3)).map(x=>List(x,x,x)).collect

It's basically the same: 基本上是一样的:

sc.parallelize(Arrays.asList(1,2,3)).flatMap(x->Arrays.asList(x,x,x).iterator()).collect();
sc.parallelize(Arrays.asList(1,2,3)).map(x->Arrays.asList(x,x,x)).collect();

where sc is a JavaSparkContext (and assuming you use Java 8 and Spark 2.0.0). 其中scJavaSparkContext (并假设您使用Java 8和Spark 2.0.0)。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM