用于Spark结构化流的Grafana
[英]Grafana for Spark Structured Streaming
问题描述
I followed these steps to setup Prometheus, Graphite Exporter and Grafana to plot metrics for Spark 2.2.1 running Structured Streaming. 
我按照以下步骤设置了Prometheus，Graphite Exporter和Grafana，以绘制运行结构化流的Spark 2.2.1的度量。 The collection metrics on this post are quite dated; 此帖子的收集指标过时； and does not include any metrics (I believe) that can be used to monitor structured streaming. 并且不包含任何可用于监视结构化流媒体的指标（我认为）。 I am especially interested in the resources and duration to execute the streaming queries that perform various aggregations. 我对执行执行各种聚合的流查询的资源和持续时间特别感兴趣。
Is there any pre-configured dashboard for spark - I was a little surprised not to find one on https://grafana.com/dashboards Which makes me suspect that Grafana is not widely used to monitor metrics for Spark. 是否有任何用于Spark的预配置仪表板-我很惊讶没有在https://grafana.com/dashboards上找到一个仪表板，这使我怀疑Grafana没有广泛用于监视Spark的指标。 If that's the case, what works better? 如果是这样，哪种方法更好？
1 个解决方案
解决方案1
0 2018-05-04 10:50:45
It looks like it is not any dashboard in the oficial Grafana dashboard, but you can check the next Spark dashboard that display metrics collected from Spark applications. 看起来它不是正式的Grafana仪表板中的任何仪表板，但是您可以检查下一个显示从Spark应用程序收集的指标的Spark仪表板。
https://github.com/hammerlab/grafana-spark-dashboards https://github.com/hammerlab/grafana-spark-dashboards
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.