使用 Prometheus 监控大量小型 Spark 集群

Question

当我每次需要时启动一个新集群时，如何使用 Prometheus（它使用“拉”方法）来监控我的 Spark 集群，这意味着我没有一个稳定的监控端点。

Answer 1

It depends a bit on how / where you spin up your clusters. When using Kubernetes, you can use Kubernetes SD configurations to discover your targets or use the Prometheus Operator (see alsohere ).

If running on EMR you could use bootstrap actions to configure the node_exporter and jmx_exporter . See this for an example how to do so.

And alternatively, you could use the Prometheus Pushgateway together with a custom Spark sink ( example ) for this use case.