如何将 Python 结果写入突触 azure 数据库？

Question

I am trying to write the result obtained using the pyspark in the notebook as a table to the database using the following code:

%%pyspark
sample=sample.head()

%%spark
spark.conf.set("spark.sql.execution.arrow.pyspark.enabled", "true")
park_df = spark.createDataFrame(sample)
park_df.write.mode("overwrite").saveAsTable("default.sample")

Unfortunately, I'm getting the following error:

Error : <console>:31: error: not found: value park_df
val $ires9 = park_df
             ^
<console>:29: error: not found: value park_df
       park_df = spark.createDataFrame(sample)

Answer 1

You may try to below to code to write the python result to synapse azure database:

%%pyspark
sample = [('CA',22,45000),('WA',35,65000)]
spark.conf.set("spark.sql.execution.arrow.pyspark.enabled", "true")
park_df = spark.createDataFrame(sample, ['state','age','salary'])
park_df.write.mode("overwrite").saveAsTable("default.sample")