[英]Is there a way to activate Giraph Stats in giraph built for yarn?
It seems that Giraph Stas are written in log only using map-reduce ( giraph-1.3.0-snapshot built with -Phadoop2 mvn profile). 看来Giraph Stas仅使用map-reduce(使用-Phadoop2 mvn配置文件构建的giraph-1.3.0-snapshot)写入日志中。
Is there a way to activate Giraph Stats in log using yarn too (giraph-1.3.0-snapshot built with -Phadoop_yarn mvn profile) ? 是否也可以使用yarn激活日志中的Giraph Stats(使用-Phadoop_yarn mvn配置文件构建的giraph-1.3.0-snapshot)?
Follows an example of Giraph Stats. 以Giraph统计资料为例。
2018-09-08 16:03:01,604 INFO org.apache.hadoop.mapreduce.Job: Counters: 42
File System Counters
FILE: Number of bytes read=74623213
FILE: Number of bytes written=75518013
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=1
Map output records=0
Input split bytes=44
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=100
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Total committed heap usage (bytes)=3087007744
Giraph Stats
Aggregate bytes loaded from local disks (out-of-core)=0
Aggregate bytes stored to local disks (out-of-core)=0
Aggregate edges=12
Aggregate finished vertices=0
Aggregate sent message bytes=3154
Aggregate sent messages=24
Aggregate vertices=5
Current master task partition=0
Current workers=1
Last checkpointed superstep=0
Lowest percentage of graph in memory so far (out-of-core)=100
Sent message bytes=1701
Sent messages=12
Superstep=2
Giraph Timers
Initialize (ms)=653
Input superstep (ms)=599
Setup (ms)=58
Shutdown (ms)=8967
Superstep 0 Worker_Superstep0 (ms)=295
Superstep 1 Worker_Superstep1 (ms)=605
Total (ms)=10538
Zookeeper base path
/_hadoopBsp/job_local881103217_0001=0
Zookeeper halt node
/_hadoopBsp/job_local881103217_0001/_haltComputation=0
Zookeeper server:port
cri:22181=0
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0
Use 采用
-ca giraph.metrics.enable=true
as explained in http://giraph.apache.org/options.html 如http://giraph.apache.org/options.html中所述
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.