繁体   English   中英

Hadoop \ HDFS:“没有这样的文件或目录”

[英]Hadoop\HDFS: “no such file or directory”

我使用本教程在一台机器上安装了Hadoop 2.2: http//www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

一些细节有点改变 - 例如,我使用java 8,/ hadoop root dir等用户,SSH,配置密钥 - 相同。

Namenode已成功格式化:

13/12/22 05:42:31 INFO common.Storage: Storage directory /hadoop/tmp/dfs/name has been successfully formatted.
13/12/22 05:42:31 INFO namenode.FSImage: Saving image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
13/12/22 05:42:32 INFO namenode.FSImage: Image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 198 bytes saved in 0 seconds.
13/12/22 05:42:32 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
13/12/22 05:42:32 INFO util.ExitUtil: Exiting with status 0
13/12/22 05:42:32 INFO namenode.NameNode: SHUTDOWN_MSG: 

但是,'mkdir'甚至都没有'ls'命令工作:

$ /hadoop/hadoop/bin/hadoop fs -ls
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /hadoop/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
13/12/22 05:39:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `.': No such file or directory

谢谢你的帮助。

尝试

hadoop fs -ls /

测试了hadoop 2.4

在Hadoop 2.4中

hdfs dfs -mkdir /input
hdfs dfs -ls /

我已经验证了这在Hadoop 2.5中有效

hdfs dfs -mkdir /input

(其中/input是HDFS目录)

在我的案例中工作:首先通过以下方式获取hadoop安装路径:

echo ${HADOOP_INSTALL} //in my case output is : `/user/local/hadoop`

然后在hadoop安装路径上创建目录,如果你知道你的hadoop安装目录忽略上面的命令

hadoop fs -mkdir -p /user/local/hadoop/your_directory

这里hadoop是目录

测试了hadoop 2.4

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM