How to delete an entire data frame in Spark(SCALA)?
Question
有一些函数可以删除Spark（SCALA）中的列和行，但找不到任何删除整个数据框的函数。有没有办法删除Spark（SCALA）中的数据框？
1 answers
solution1
1 2016-10-15 20:20:57
I'm not sure about which functions you are referring to delete columns from DFs. Spark Dataframes are immutable in nature as like RDDs . According to my understanding , its not possible. Only way to exaust an DF is garbage collection.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
How to flatten a data frame in apache spark | Scala
How to rename spark data frame output file in AWS in spark SCALA
spark Scala data frame select
Tuple to data frame in spark scala
How to use withColumn with condition for the each row in Scala / Spark data frame
how to access map values and keys stored in a data frame in scala spark
How to filter a map<String, Int> in a data frame : Spark / Scala
How to find the phrase count from data frame in spark scala?
How to aggregate a Spark data frame to get a sparse vector using Scala?
How to read such a nested multiline json file into a data frame with Spark/Scala
Related Tags