Does spark on mesos support data locality?
Question
Does spark on mesos support data locality? Assume mesos agents run on datanode.
1 answers
solution1
1 2018-02-11 11:26:22
Data locality support doesn't depend on the cluster manager at all. It depends only on the source of the data. So if you talk about HDFS datanode then the answer is positive - it does support data locality.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
Does Spark use data locality?
spark + hadoop data locality
Data Locality in Spark on Kubernetes
Data locality with Spark standalone and HDFS
Data Locality in Spark on Kubernetes colocated with HDFS pods
What exactly does Data Locality mean in Hadoop?
Spark Streaming and Data Locality when dynamically loading files
How can i change data locality on Apache Spark
Deploying Spark and HDFS on Docker Swarm doesn't enable data locality
Standalone Spark cluster on Mesos accessing HDFS data in a different Hadoop cluster
Related Tags