Spark 找不到- spark-class-launcher-output-28018.txt

Question

Using Spark1.6.2, win7-64, jdk8, have winutils, HADOOP_HOME. Have a valid spark setup, can run the examples, start spark-shell, etc %temp% is correctly setup C:\Users\~\AppData\Local\Temp

spark-submit --class "com.iot.app.spark.processor.IoTDataProcessor" iot-spark-processor-1.0.0.jar

The system cannot find the

file C:\Users\~\AppData\Local\Temp\spark-class-launcher-output-28018.txt

Thanks

Answer 1

This has to do with Permissions on temp folders

List current permissions: %HADOOP_HOME%\bin\winutils.exe ls \tmp\hive

Set permissions: %HADOOP_HOME%\bin\winutils.exe chmod 777 \tmp\hive

Set permissions: %HADOOP_HOME%\bin\winutils.exe chmod 777 C:\Users\~\AppData\Local\Temp

Answer 2

it's about using

""

with the class name

Answer 3

It sounds like you encountered a problem with your JAVA_HOME path being misconfigured, which caused issues for you. Add a environment variable name JAVA_HOME and add jdk path as value.