为什么 spark-submit 无法部署到 YARN？

Question

I'm running a simple java application in spark, however when I try to submit the application, it shows cannot load main class from Jar file. Here is a snapshot of the error.

Answer 1

您需要提供--class和--master参数。

spark-submit --master yarn-client --class spark.examples.SimpleApp /root/simple-project-1.0.jar hdfs://myserver1:8020/user/root/hackrfoe.txt