How to setup apache shark on Hadoop yarn?
Question
I have setup a spark cluster on hadoop yarn and now i want to setup shark on spark. but there are no article to setup shark on spark which is setup on yarn. Is there any way we can do that or should i move setup my spark cluster as stand alone cluster.
1 answers
solution1
-1 2014-08-08 22:57:19
Here is one of the working model i have implemented
https://github.com/amplab/shark/wiki/Running-Shark-on-a-Cluster
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Hadoop YARN setup authentication issue
Apache Hadoop Yarn - Underutilization of cores
How wordCount mapReduce jobs, run on hadoop yarn cluster with apache tez?
AMPLab Shark on Apache Spark
Issue with Apache Spark working on Hadoop YARN
Hadoop YARN - how to limit requestedMemory?
how to disable yarn in hadoop 2.4?
installing HDFS for use with SHARK without YARN
YARN and Hadoop
How to setup webhdfs hadoop
Related Tags