什么是 Databricks Spark 集群管理器？ 可以改变吗？
[英]What is Databricks Spark cluster manager? Can it be changed?
问题描述
Original Spark distributive supports several cluster managers like YARN, Mesos, Spark Standalone, K8s.
原始 Spark 分布式支持多个集群管理器，如 YARN、Mesos、Spark Standalone、K8s。 I can't find what is under the hood in Databricks Spark, which cluster manager it is using, and is it possible to change?我找不到 Databricks Spark 的底层内容，它正在使用哪个集群管理器，是否可以更改？
What's Databricks Spark architecture?什么是 Databricks Spark 架构？
Thanks.谢谢。
1 个解决方案
解决方案1
1 2021-03-15 14:49:40
You can't check the cluster manager in Databricks, and you really don't need that because this part is managed for you.您无法检查 Databricks 中的集群管理器，并且您确实不需要它，因为这部分是为您管理的。 You can think about it as a kind of standalone cluster, but there are differences.您可以将其视为一种独立的集群，但存在差异。 General Databricks architecture is shown here .此处显示了通用 Databricks 架构。
You can change the cluster configuration by different means - init scripts, configuration parameters, etc. See documentation for more details.您可以通过不同的方式更改集群配置 - 初始化脚本、配置参数等。有关详细信息，请参阅文档。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.