简体   繁体   English

apache-pig map-reduce错误分组

[英]apache-Pig map-reduce group by error

I think I am running into a real problem now and need some expert advice. 我认为我现在遇到了一个实际问题,需要一些专家建议。 I am running below scripts in grunt shell and everything is running fine except dump d; 我在grunt shell中的脚本下运行,除了dump d之外,其他所有程序都运行良好; I am getting below error. 我正在错误以下。

2016-03-28 20:08:30,686 [main] ERROR org.apache.pig.tools.pigstats. 2016-03-28 20:08:30,686 [main]错误org.apache.pig.tools.pigstats。 mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed! mapreduce.MRPigStatsUtil-1个地图缩小作业失败!

--I am this script below

a = LOAD '/user/admin/pig/scripts/pig1.csv' USING PigStorage(',') AS (pid chararray,id:int,city:chararray);  
    describe a ;  
    b = LIMIT a 100;  
    C = FOREACH a generate pid, id;  
    dump C;  
    d = group C by pid; dump d;  

Please help. 请帮忙。

If the problem is only with dump d; 如果问题仅出在dump d; may there is some hidden character on that line. 那行上可能有一些隐藏的字符。 You can use editor like BBEdit and turn on the show invisibles to see if any hidden special chars are there on this line. 您可以使用BBEdit之类的编辑器并打开show invisibles来查看此行上是否有任何隐藏的特殊字符。 I tried running the script as it is and its working fine. 我尝试按原样运行脚本,并且可以正常运行。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM