简体   繁体   中英

apache-Pig map-reduce group by error

I think I am running into a real problem now and need some expert advice. I am running below scripts in grunt shell and everything is running fine except dump d; I am getting below error.

2016-03-28 20:08:30,686 [main] ERROR org.apache.pig.tools.pigstats. mapreduce.MRPigStatsUtil - 1 map reduce job(s) failed!

--I am this script below

a = LOAD '/user/admin/pig/scripts/pig1.csv' USING PigStorage(',') AS (pid chararray,id:int,city:chararray);  
    describe a ;  
    b = LIMIT a 100;  
    C = FOREACH a generate pid, id;  
    dump C;  
    d = group C by pid; dump d;  

Please help.

If the problem is only with dump d; may there is some hidden character on that line. You can use editor like BBEdit and turn on the show invisibles to see if any hidden special chars are there on this line. I tried running the script as it is and its working fine.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM