Hadoop: Measuring the duration of each phase(map, shuffle/sort, reduce)

Question

There's a very similar question what I want to know. How can I measure the duration of each phase(map, shuffle/sort, reduce) in Hadoop? The answer says that web/ui of tasktracker shows each duration of the application. But my environment is hadoop-2.2.0 and there's no tasktracker. So tasktracker web/ui "localhost:50030/tasktracker.jsp" is not working. The answer is appropriate only for lower version of hadoop(1.xx), I guess.

How can I measure the duration of each phase(map, shuffle/sort, reduce) in hadoop-2.xx version? Is there any other web/ui for check them?

My environment: Red hat 6.3, hadoop-2.2.0.

Answer 1

This information can be seen via jobhistory URL http://localhost:19888/jobhistory .Click on "job id" from the "retired job" list and it will show you average map,reduce,shuffle and merge time for job. If you click on map or reduce tasks you can see details about each task's start and end time.