Can not find “Spark.dynamicAllocation.enabled” property in CDH 5.4.7 UI
Question
I can not find the Spark.dynamicAllocation.enabled property in CDH 5.4.7 UI. I have searched the configuration of both the Spark and YARN services. But failed to locate. I am using Spark 1.3.0.
Any help would be appreciated.
1 answers
solution1
0 ACCPTED 2016-12-21 05:43:47
You can find it in /etc/spark/conf.cloudera.spark_on_yarn/spark-defaults.conf over CLI
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.
Related Question
spark.executor.instances over spark.dynamicAllocation.enabled = True
How to change Spark setting to allow spark.dynamicAllocation.enabled?
How does spark.dynamicAllocation.enabled influence the order of jobs?
DynamicAllocation enabled with Spark on Kubernetes?
Can we change the spark.dynamicAllocation.minExecutors after creating a spark session?
I can't enable spark parcel in CDH5.4
Can I have multiple spark versions installed in CDH?
CDH5.4.2 spark can use HiveContent in spark-shell but can't open spark-sql
Not able to install Spark 2.0 in CDH 5.7.5
Running Spark2 from Oozie (CDH)
Related Tags