简体   繁体   English

使用hadoop-mapreduce-examples-2.7.7.jar时出错

[英]Error at using hadoop-mapreduce-examples-2.7.7.jar

I have hadoop 我有Hadoop

hadoop@nodo1:/opt/hadoop$ hadoop version Hadoop 2.7.7 Subversion Unknown -r c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac Compiled by stevel on 2018-07-18T22:47Z Compiled with protoc 2.5.0 From source with checksum 792e15d20b12c74bd6f19a1fb886490 This command was run using /opt/hadoop/share/hadoop/common/hadoop-common-2.7.7.jar hadoop @ nodo1:/ opt / hadoop $ hadoop版本Hadoop 2.7.7 Subversion未知-r c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac由stevel于2018-07-18T22:47Z编译与协议2.5.0来自带有校验和的源代码2.5.0 /使用校验和792e15d20b19c74bd886的hadoop /共享/ hadoop的/普通/ Hadoop的共2.7.7.jar

And as learned in a course, I use 正如在课程中所学到的

/opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount 

But when i run this, the next error is shown: 但是当我运行它时,显示下一个错误:

hadoop@nodo1:/opt/hadoop$ hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount /libros /output3 hadoop @ nodo1:/ opt / hadoop $ hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount / libros / output3

org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://nodo1:9000/output3 already exists at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146) at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308) at org.apache.hadoop.examples.WordCount.main(WordCount.java:87) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Native org.apache.hadoop.mapred.FileAlreadyExistsException:输出目录hdfs:// nodo1:9000 / output3在org.apache的org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:146)已存在org.apache.hadoop.mapreduce.Job $ .run.JodSub.mr.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266)(位于org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139))在org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1287)在java.security.AccessController.doPrivileged(本机方法)在javax.security.auth.Subject.doAs(Subject.java) :422)位于org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762),位于org.apache.hadoop.mapreduce.Job.submit(Job.java:1287),位于org.apache.hadoop.mapreduce。 org.apache.hadoop.examples.WordCount.main(WordCount.java:87)处的Job.waitForCompletion(Job.java:1308)位于sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)处的sun.reflect.NativeMethodAccessorImpl.invoke(本地人 MethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:226) at org.apache.hadoop.util.RunJar.main(RunJar.java:141) org.apache.hadoop.util.ProgramDriver $ ProgramDescription上的sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)处的MethodAccessorImpl.java:62)在org.apache.hadoop.util上的.invoke(ProgramDriver.java:71)在org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)处的ProgramDriver.run(ProgramDriver.java:144)。在java.lang.reflect.Method.invoke(sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)处的sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)处的Reflection.NativeMethodAccessorImpl.invoke0(本机方法) org.apache.hadoop.util.RunJar.run(RunJar.java:226)上的Method.java:498)org.apache.hadoop.util.RunJar.main(RunJar.java:141)上的Method.java:498)

In the path i have a book 在路上我有一本书

hadoop@nodo1:/opt/hadoop$ hdfs dfs -ls /libros/ Found 1 items -rw-r--r-- 1 hadoop supergroup 2198927 2018-11-02 10:22 /libros/quijote.txt hadoop @ nodo1:/ opt / hadoop $ hdfs dfs -ls / libros /找到1项-rw-r--r-- 1 hadoop超群2198927 2018-11-02 10:22 /libros/quijote.txt

TNK from your help TNK在您的帮助下

First do 先做

hdfs dfs -ls /output3

If there is a file then, 如果有文件,

Either Delete , Output directory hdfs://nodo1:9000/output3 or, 删除 ,输出目录hdfs://nodo1:9000/output3

Use different file name 使用不同的文件名

# Change output3 to output4
hadoop jar /opt/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.7.jar wordcount /libros /output4 

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM