I am using spark-sql to execute big SQL files. I want to log SQL query before spark executes it, something similar to hive verbose mode. I have tried spark-sql CLI with -v
parameter to verbose but still, it doesn't print SQL query.
spark-sql -v \
<configuration parameters> \
-f abc.sql
Hive command:
hive -v \
<configuration parameters> \
-f abc.sql
Is there any other spark configuration that I am missing to print SQL query?
spark-sql verbose mode is --v
whereas hive verbose mode is -v
.
Below command works for me-
spark-sql --v \
<configuration parameters> \
-f abc.sql
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.