使用 as.data.frame 在 Spark 中的 R 中创建数据帧时出错

Question

I am trying to convert SparkDataFrame to R data frame.

%python

temp_df.createOrReplaceTempView("temp_df_r")

%r

temp_sql = sql("select * from temp_df_r")

temp_r = as.data.frame(temp_sql)

Error in as.data.frame.default(temp_sql) : cannot coerce class 'structure("SparkDataFrame", package = "SparkR")' to a data.frame

Sometimes I get error, it's still unknown why I get error sometimes and sometimes not.

Answer 1

I need more details. What environment do you use?