Elastic Map Reduce Error

Question

I am getting an error when using Elastic Map Reduce and I am not sure what it means because it is not very descriptive. I want to know specifically what kind of JSONDecodeError I am getting. "12" is not descriptive. This is the output. I am using the MRjob class

writing to step-0-mapper_part-00000
writing to step-0-mapper_part-00001
Counters from step 1:
  Undecodable input:
    JSONDecodeError: 12
  Unencodable output:
   TypeError: 2
writing to /tmp/emr_irene.ec2-user.20130716.171313.288877/step-0-mapper-sorted
> sort /tmp/emr_irene.ec2-user.20130716.171313.288877/step-0-mapper_part-00000 /tmp/emr_irene.ec2-     user.20130716.171313.288877/step-0-mapper_part-00001
writing to step-0-reducer_part-00000
Counters from step 1:
 Undecodable input:
 JSONDecodeError: 12
 Unencodable output:
   TypeError: 2

Answer 1

The number 12 in this case is the number of json encode errors you had. To find out specifically why they failed the best way I know how is by reducing your input set and triangulating the issue by rerunning the job.

Answer 2

如果您正在使用Amazon AWS，则可以运行以下脚本，您将获得有关错误的更多信息：

python -m mrjob.tools.emr.fetch_logs --find-failure YOUR_JOB_ID