stackoom
  简体   繁体   中英

In spark streaming, what is the difference between foreach and foreachRDD

 原文  2016-09-21 11:31:39  8   1    scala/ apache-spark/ rdd/ dstream/ bigdata

Question

For example, how would 

x.foreach(rdd => rdd.cache())

be different from 

x.foreachRDD(rdd => rdd.cache())

Note that x is a DStream here.

1 answers

solution1
 2 ACCPTED  2016-09-21 11:45:40

There is no difference in work, foreach() uses foreachRDD. foreach() was deprecated and in Spark 2.0 this function is removed

暂无
暂无

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

Related Question DB connection with foreachRDD Spark Streaming Spark Streaming Saving data to MySQL with foreachRDD() in Scala Spark Streaming: How to change the value of external variables in foreachRDD function? How to foreachRDD over records from Kafka in Spark Streaming? Spark Structured Streaming with foreach What is the difference between onComplete and foreach for a future in Scala? Spark streaming store method only work in Duration window but not in foreachRDD workflow in customized receiver Why does Spark Streaming execute foreachRDD even when no new data is available? spark streaming foreach multiple writer What is difference between transformations and rdd functions in spark?
Related Tags
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM