使用Java在独立模式下运行Spark

Question

I've a problem: I cannot run a MapReduce Spark Job written in Java in AWS enviorment EMR. I've a maser node and 5 slaves.

What is the correct way to let Spark run the java class?

I tried with this guide but it doesn't work to me.

Thanks!!

Answer 1

The amazon documentation is probably better suited for EMR specific setup questions. https://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-spark-interactive-batch.html (specifically https://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-spark-submit-step.html for batch jobs).