简体   繁体   中英

Hadoop Map-Reduce Output File Exception

I am getting this error on runing a single node hadoop cluster on amazon d2.2Xlarge.I also cannot view my output.Can anyone provide me with the proper steps to resolve this issue?

"Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not
 find any valid local directory for output/file.out"

This are my steps executed.

bin/hdfs dfsadmin -safemode leave                            
bin/hadoop fs -mkdir /inputfiles    
bin/hadoop dfsadmin -safemode leave    
bin/hadoop fs -mkdir /output    
bin/hdfs dfsadmin -safemode leave       
bin/hadoop fs -put input1 /inputfiles    
bin/hdfs dfsadmin -safemode leave   
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar  
wordcount /inputfiles /output

You should not create output directory for Map Reduce job.

Remove this command

bin/hadoop fs -mkdir /output  

And change last command as

bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.2.jar  
wordcount /inputfiles /output1

Make sure that you have permissions to create output1 under /

If not, I would prefer below directory strucuture.

/home/your_user_name/input for input directory files and

/home/your_user_name/output for output directory.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM