I am getting this error on runing a single node hadoop cluster on amazon d2.2Xlarge.I also cannot view my output.Can anyone provide me with the proper steps to resolve this issue?
"Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not
find any valid local directory for output/file.out"
This are my steps executed.
bin/hdfs dfsadmin -safemode leave
bin/hadoop fs -mkdir /inputfiles
bin/hadoop dfsadmin -safemode leave
bin/hadoop fs -mkdir /output
bin/hdfs dfsadmin -safemode leave
bin/hadoop fs -put input1 /inputfiles
bin/hdfs dfsadmin -safemode leave
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar
wordcount /inputfiles /output
You should not create output directory for Map Reduce job.
Remove this command
bin/hadoop fs -mkdir /output
And change last command as
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar
wordcount /inputfiles /output1
Make sure that you have permissions to create output1
under /
If not, I would prefer below directory strucuture.
/home/your_user_name/input
for input directory files and
/home/your_user_name/output
for output directory.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.