pyspark 中 spark.sql() 和 cursor.execute 的区别？

Question

what is difference in working of both. as i am getting result in executing below command.

spark.sql("select * from MetadataTable").show()

but when i am trying to run cursor.execute("select * from MetadataTable") , it is showing me error

"metadatatable" does not exist

what should I do access table "metadatatable" by cursor.execute ?

Answer 1

At a glance, spark.sql is the spark way to use SQL to work with your data.

Cursor.execute does not appear to be spark code.

Perhaps it is python code for interaction with a database.

You could share the documentation if this seems wrong, but probably reviewing the documentation should explain what it is.