Hive在Spark StackOverFlow错误

Question

i am running Hive on Spark on CDH 5.10. and i get the below error. I have checked all the logs of YARN , Hive and Spark, but there is no useful information apart from the below error:

Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 4, xxx.local, executor 1): java.lang.StackOverflowError

Answer 1

Tyr to set the following parameters before executing your query:

set spark.executor.extraJavaOptions=-Xss16m;
set hive.execution.engine=spark;