Scala 中的 saveasTextFile("path")

Question

I used Scala in Spark, and I tried to save my file in HDFS file, but I got an error.

I have tried rdd.saveAsTextFile("path"); sc.saveAsTextFile("pathe"); saveAsTextFile("path") rdd.saveAsTextFile("path"); sc.saveAsTextFile("pathe"); saveAsTextFile("path")

scala> inputJPG.map(x=>x.split("")).map(array=>array(0)).sc.saveAsTextFile("/loudacre/iplist")
    <console>:28: error: value sc is not a member of Array[String]
                  inputJPG.map(x=>x.split("")).map(array=>array(0)).sc.saveAsTextFile("/loudacre/iplist")

Answer 1

I'm a new student and still learning Scala, so not familiar with RDD and Scala function. Turn to my problem.I found that is because I have val xx=data.collect() before which is not RDD, so I can't do data.saveAsTextFile in Spark. So I moved the .collect() function => val xx=data Then data.savaAsTextFile("path") works.