mapreduce job not running

Question

I am trying to run mapreduce but able to run getting below error

16/04/28 13:17:07 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/04/28 13:17:07 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/04/28 13:17:08 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:09 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:10 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:11 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:12 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:13 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:14 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

Please Note I have checked the question no 20620949 and toster.ru/q/57046#answer_208326 and many other relevant after verifying above Ifound yarn is not installed in my local machine,so please let me know is yarn is required to run MR job in single machine I mean in my local linux box (no cluster nothing) , can we run MR jobs without yarn?

Answer 1

with hadoop-2 it YARN is the default scheduler, which manages resource/containers. So it is mandatory to have YARN. You may start YARN services on single host, it doesn't require any cluster.

Answer 2

Technically you don't need to install YARN. In that case you'll need to install hadoop-mapreduce-v1. But MRv1 is deprecated and you shouldn't use it. My guess is that you already have YARN installed but you just haven't started the service.

One of the other things you can do is to get an out-of-the-box image from one of the Hadoop distribution vendors: Cloudera or Hortonworks.

Answer 3

现在已经解决了，我正在使用Chef进行部署，在那里找不到“ start-yarn.sh”，但是当我启动服务“ hadoop-yarn-resourcemanager”时，我们将其作为服务全部开始使用，无论如何，谢谢您的建议和意见。