简体   繁体   English

如何在Cloudera上安装HDFS?

[英]How to mount HDFS on Cloudera?

I am working on a cluster running Cloudera 5.3, and I've followed all the instructions to create an NFS gateway and it's running fine. 我正在运行Cloudera 5.3的集群上工作,并且已经按照所有说明创建了NFS网关,并且该网关运行良好。 My problem is that I still can't see the HDFS directories as part of the Linux file system (this is RHEL 6). 我的问题是我仍然看不到HDFS目录是Linux文件系统(这是RHEL 6)的一部分。 I'm not a UNIX admin so I have no experience mounting directories, and the documentation I'm finding online isn't helping with this specific problem. 我不是UNIX管理员,所以我没有安装目录的经验,并且在网上找到的文档无法解决此特定问题。 I've tried the simple 我尝试过简单

mount /

On the machine that is the NFS gateway, but that didn't work. 在作为NFS网关的计算机上,但这没有用。 When I tried from another cluster machine to mount using 当我尝试从另一台群集计算机挂载使用

mount <myNFSgateway>:/ /

I couldn't see any of the files on the gateway server nor in HDFS (though I can easily see the files using hdfs dfs -ls ). 我看不到网关服务器或HDFS上的任何文件(尽管我可以使用hdfs dfs -ls轻松查看文件)。

How do I actually mount HDFS as a directory now that NFS is set up? 既然已经设置了NFS,如何实际将HDFS挂载为目录?

Try the below command for checking available mount points 尝试使用以下命令检查可用的安装点

showmount -e <nfs_server_ip_address>

You should see output similar to the following: 您应该看到类似于以下内容的输出:

Exports list on <nfs_server_ip_address>: 
/ (everyone)

Mounting HDFS on an NFS Client To import the HDFS file system on an NFS client, use a mount command such as the following on the client: 在NFS客户端上挂载HDFS要在NFS客户端上导入HDFS文件系统,请在客户端上使用以下安装命令:

 mount -t  nfs  -o vers=3,proto=tcp,nolock <nfs_server_hostname>:/ /hdfs_nfs_mount

(Before mounting make sure the nfs related libraries are installed. if not, install the libraries using the command sudo yum install nfs-utils nfs-utils-lib ) (在安装之前,请确保已安装与nfs相关的库。如果未安装,请使用命令sudo yum install nfs-utils nfs-utils-lib

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM