简体   繁体   English

有没有一种方法可以激活为纱线制造的giraph中的Giraph统计?

[英]Is there a way to activate Giraph Stats in giraph built for yarn?

It seems that Giraph Stas are written in log only using map-reduce ( giraph-1.3.0-snapshot built with -Phadoop2 mvn profile). 看来Giraph Stas仅使用map-reduce(使用-Phadoop2 mvn配置文件构建的giraph-1.3.0-snapshot)写入日志中。

Is there a way to activate Giraph Stats in log using yarn too (giraph-1.3.0-snapshot built with -Phadoop_yarn mvn profile) ? 是否也可以使用yarn激活日志中的Giraph Stats(使用-Phadoop_yarn mvn配置文件构建的giraph-1.3.0-snapshot)?

Follows an example of Giraph Stats. 以Giraph统计资料为例。

2018-09-08 16:03:01,604 INFO org.apache.hadoop.mapreduce.Job: Counters:   42
File System Counters
    FILE: Number of bytes read=74623213
    FILE: Number of bytes written=75518013
    FILE: Number of read operations=0
    FILE: Number of large read operations=0
    FILE: Number of write operations=0
Map-Reduce Framework
    Map input records=1
    Map output records=0
    Input split bytes=44
    Spilled Records=0
    Failed Shuffles=0
    Merged Map outputs=0
    GC time elapsed (ms)=100
    CPU time spent (ms)=0
    Physical memory (bytes) snapshot=0
    Virtual memory (bytes) snapshot=0
    Total committed heap usage (bytes)=3087007744
Giraph Stats
    Aggregate bytes loaded from local disks (out-of-core)=0
    Aggregate bytes stored to local disks (out-of-core)=0
    Aggregate edges=12
    Aggregate finished vertices=0
    Aggregate sent message bytes=3154
    Aggregate sent messages=24
    Aggregate vertices=5
    Current master task partition=0
    Current workers=1
    Last checkpointed superstep=0
    Lowest percentage of graph in memory so far (out-of-core)=100
    Sent message bytes=1701
    Sent messages=12
    Superstep=2
Giraph Timers
    Initialize (ms)=653
    Input superstep (ms)=599
    Setup (ms)=58
    Shutdown (ms)=8967
    Superstep 0 Worker_Superstep0 (ms)=295
    Superstep 1 Worker_Superstep1 (ms)=605
    Total (ms)=10538
Zookeeper base path
    /_hadoopBsp/job_local881103217_0001=0
Zookeeper halt node
    /_hadoopBsp/job_local881103217_0001/_haltComputation=0
Zookeeper server:port
    cri:22181=0
File Input Format Counters
    Bytes Read=0
File Output Format Counters
    Bytes Written=0

Use 采用

-ca giraph.metrics.enable=true

as explained in http://giraph.apache.org/options.html http://giraph.apache.org/options.html中所述

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM