简体   繁体   English

使用Oozie工作流程时hadoop任务的hprof数据存储在哪里-测量内存使用情况

[英]Where is the hadoop task's hprof data stored when using oozie workflow - measuring memory usage

I've followed the instructions in the hadoop definitive guide (also mentioned here How to check memory footprint of Map Task in Hadoop ). 我已经按照hadoop最终指南中的说明进行操作(在此处还提到了如何在Hadoop中检查Map Task的内存占用 )。 However, after the task is finished, I can't find any data to look at. 但是,任务完成后,我找不到要查看的任何数据。

In the book it says that the data is moved to where the client is ran from...I'm using oozie workflow, I wonder where is the hprof data moved to in my case? 在书中,它说数据已移至运行客户端的位置...我正在使用oozie工作流,我想知道我的hprof数据移至何处?

The logs are places in the same place as all the other logs. 日志与其他所有日志位于同一位置。 On cloudera dist, I found them on the data node: hadoop.job.history.location 在cloudera dist上,我在数据节点上找到它们:hadoop.job.history.location

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM