如何将文件从远程服务器复制到hdfs位置

Question

I want to copy files from a remote server using sftp to an hdfs location directly without copying the files to local. 我想使用sftp将文件从远程服务器直接复制到hdfs位置，而无需将文件复制到本地。 The hdfs location is a secured cluster. hdfs位置是受保护的群集。 Please suggest if this is feasible and how to proceed in that case. 请建议这是否可行以及在这种情况下如何进行。 Also I would want to know if there is any other way to connect and copy apart from sftp. 我也想知道是否还有其他方法可以连接和复制sftp。

Answer 1

I think the most convenient way (given that your remote machine is able to connect to the hadoop cluster) is to make that remote machine act as an HDFS client. 我认为最方便的方法（假设您的远程计算机能够连接到hadoop群集）是使该远程计算机充当HDFS客户端。 Just ssh to that machine, install the hadoop distribution, configure it properly, then run: 只需SSH到那台机器，安装hadoop发行版，对其进行正确配置，然后运行：

hadoop fs -put /local/path /hdfs/path

如何将文件从远程服务器复制到hdfs位置

问题描述

1 个解决方案

解决方案1
1 2014-09-04 08:31:57

如何将文件从远程服务器复制到hdfs位置

问题描述

1 个解决方案

解决方案1 1 2014-09-04 08:31:57

解决方案1
1 2014-09-04 08:31:57