将文件从1个群集的本地计算机传输到另一个群集的hdfs

Question

I have 2 hadoop clusters(A and B) and want to transfer a file from local of cluster A to HDFS of cluster B. Is there a way to do it?

I tried copyFromLocal and put but looks like they don't copy the file over to the HDFS of cluster B and show that they are not supported: copyFromLocal: Not supported

fyi: connection looks open as I am able to read HDFS of cluster B from local of cluster A(hadoop fs -ls hdfs://NNofB:port/path)

Answer 1

不知道从HDFS-> HDFS是否有直接方法，但是您可以从ClusterA中某个节点上的HDFS get数据，将数据scp到ClusterB中的节点，然后put数据从ClusterB中的该节点放入HDFS。