繁体   English   中英

Hortonworks沙箱中的猪错误

[英]Pig error in hortonworks sandbox

我是Hadoop的初学者。 我在hortonworks沙箱中的猪代码是:

raw=load 'SchoolDataSet.csv' using org.apache.hcatalog.pig.hcatloader();

es=foreach raw generate times as timestamp,ip,country,status;

store es into 'SchoolDataSet.csv'using org.dataset.hadoop.pig.esstorage();

stock_a=load 'SchoolDataSet.csv' using pigstore(',')

AS (name:chararray,TypeofSchool:chararray,

SexStudents:boolean, Branchofstudy:chararray,

Evidence:chararray, FieldofStudy:chararray,

Side:chararray,Status:chararray, Cityoffice:chararray,

LessonName:chararray,PersonalCode:int,

SchoolCode:int, LessonCode:int,NumberOfStudents:int,

OfreNewal:int,ReasonableNumber:int,

Meanscores:float,Acceptancerate:float,Experience:int);

describe stock_a;

B = LIMIT STOCK_A 100;

DESCRIBE B;

dump b;

C = FOREACH B GENERATE symbol, date, close;

DESCRIBE C;

STORE C INTO 'output/C';

沙箱中的错误是这样的:

ls: cannot access /usr/lib/hive/lib/slf4j-api-*.jar: No such file or directory

2015-05-15 12:37:13,349 [main] INFO org.apache.pig.Main - Apache Pig    version 0.12.1.2.1.1.0-385

(rexported) compiled Apr 16 2014, 15:59:00

2015-05-15 12:37:13,350 [main] INFO org.apache.pig.Main - Logging error messages to:

/hadoop/yarn/local/usercache/hue/appcache/application_1431515718576_0020/container_143151

5718576_0020_01_000002/pig_1431718633347.log

2015-05-15 12:37:14,510 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file

/home/yarn/.pigbootup not found

2015-05-15 12:37:14,869 [main] INFO   org.apache.hadoop.conf.Configuration.deprecation -

mapred.job.tracker is deprecated. Instead, use mapreduce.jobtrac
1 of 2
Displaying SandBoxCode.docx.

怎么了?

您可能会收到此错误,因为尚未更新.bashrc变量。 进入vi〜/ .bashrc然后插入

export PIG_HOME=/usr/lib/pig/pig-0.12.0 
export PATH=$PATH:$PIG_HOME/bin 

然后尝试在mapreduce版本中执行pig:

猪-x mapreduce

现在,您可以通过“ grunt>”执行您的Pig脚本。 如果要运行Shell脚本,请尝试以下操作: https : //github.com/sindresorhus/grunt-shell

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM