無法使用cygwin在Windows 7上運行Pig

Question

我按照文檔中的說明配置了Pig。 環境：Windows 7，Hadoop-0.20.2，pig 0.13.0，Cygwin

但是，當我在命令提示符下鍵入pig（mapreduce）時，它僅顯示以下內容。 我不確定是否開始養豬。 我看不到GRUNT Shell執行腳本。

順便說一句，Hadoop在同一節點上運行。

有人可以幫忙嗎？

$ pig在/hadoop-0.20.2/bin/hadoop空運行中找到hadoop：HADOOP_CLASSPATH：C：\\ cygwin64 \\ pig-0.13.0 \\ conf; C; C：\\ Program Files \\ Java \\ jdk1.6.0_25 \\ lib \\的tools.jar; C; C：\\ cygwin64 \\ Hadoop的0.20.2 \\ CONF; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ accumulo核-1.5.0.jar; C：\\ cygwin64 \\豬0.13 0.0 \\ lib中\\ accumulo-命運-1.5.0.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ accumulo - 服務器 - 1.5.0.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ accumulo - 開始 - 1.5.0.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ accumulo痕量-1.5.0.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\阿夫羅-1.7 .5.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\阿夫羅-mapred-1.7.5.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\阿夫羅工具-1.7.5-nodeps的.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ Groovy的全1.8.6.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ HBase的-0.94.1.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ JRuby的完整-1.6.7.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ JS-1.7R2.jar; C：\\ cygwin64 \\豬0.13.0 \\ lib中\\ JSON-簡單-1.1.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ Jython的獨立-2.5.3.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\ piggybank.jar ; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\的protobuf-java的2.4.0a.jar; C：\\ cygwin64 \\豬-0.13.0 \\ lib中\\祖克 eeper-3.4.5.jar：C：\\ cygwin64 \\ PIG-01〜1.0 / pig-withouthadoop-h2.jar：HADOOP_OPTS：-Xmx1000m -Dpig.log.dir = C：\\ cygwin64 \\ PIG-01〜1.0 \\ logs -Dpig.log.file = pig.log -Dpig.home.dir = C：\\ cygwin64 \\ PIG-01〜1.0 \\ HADOOP_CLIENT_OPTS：-Xmx1000m -Dpig.log.dir = C：\\ cygwin64 \\ PIG-01〜1.0 \\日志-Dpig.log.file = pig.log -Dpig.home.dir = C：\\ cygwin64 \\ PIG-01〜1.0 \\ /hadoop-0.20.2/bin/hadoop jar C：\\ cygwin64 \\ PIG-01〜1.0 /pig-withouthadoop-h2.jar

當我在調試模式下運行時，我看到此異常。 這是因為未設置Hadoop Jar。

localhsot@mymachine~
$ echo $PIG_INSTALL
C:\cygwin64\pig-0.13.0

localhsot@mymachine~
$ export PIG_INSTALL=/cygdrive/c/cygwin64/pig-0.13.0

localhsot@mymachine~
$ export HADOOP_INSTALL=/cygdrive/c/cygwin64/hadoop-0.20.2/

localhsot@mymachine~
$ export PATH=$PATH:$PIG_INSTALL/bin:$HADOOP_INSTALL/bin


$ pig
14/08/26 14:05:12 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
14/08/26 14:05:12 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
14/08/26 14:05:12 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2014-08-26 14:05:12,998 [main] INFO  org.apache.pig.Main - Apache Pig version 0.                                                                                                                                                  13.0 (r1606446) compiled Jun 29 2014, 02:27:58
2014-08-26 14:05:12,998 [main] INFO  org.apache.pig.Main - Logging error message                                                                                                                                                  s to: C:\cygwin64\home\chparekh\pig_1409076312996.log
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/map                                                                                                                                                  reduce/task/JobContextImpl
        at org.apache.pig.tools.pigstats.PigStatsUtil.<clinit>(PigStatsUtil.java                                                                                                                                                  :68)
        at org.apache.pig.Main.run(Main.java:643)
        at org.apache.pig.Main.main(Main.java:156)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.                                                                                                                                                  java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces                                                                                                                                                  sorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.task.Jo                                                                                                                                                  bContextImpl
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        ... 8 more

Answer 1

您可以參考下面的鏈接，希望對您有所幫助。 http://abhijitsureshshingate.wordpress.com/2013/07/08/code-debug-test-apache-pig-scripts-using-eclipse-on-windows/