How to Mount Secure HDFS?

Question

To let the standard file system user or a program see the HDFS name space as a locally mounted directory, CDH4 ie has a hadoop-hdfs-fuse component.

It is working with NON secure HDFS, but on a Kerberos secured HDFS, how to do it there?

Thks.

Answer 1

Kerberos authentication support for fuse_dfs executable (shipped with Hadoop distribution) has been added since version 2.0.2 of Apache Hadoop distribution.

I have spent a lot of time on figuring out how this should be configured.I have found that In order to make Fuse-DFS pick the correct configuration files(that contain authentication type, kerberos not simple etc...), CLASSPATH must contain HADOOP_CONF_DIR before Hadoop jar directories .

When using Kerberos authentication, users must run kinit before accessing the FUSE mount point. Failing to do this will result in I/O errors when users attempt to access the mount point.

Answer 2

您可以使用支持Kerberos的py-hdfs-mount，并且更容易设置： https ： //github.com/EDS-APHP/py-hdfs-mount

Answer 3

hdfs保险丝模块还没有kerberos支持。