如何将文件的内容分配到几个节点？

Question

I need to distribute the content of a file (upto 5 GB) over a Network such that each distributed node(XML or Simple File) of a file won't have replicate data and get synced with each other.

On a bigger note there could be more than 1000 of Big Files which needs to be take place in Distribution process.

Can i use Hadoop HDFS for Storing Big Files and use cluster Nodes for Distributed data?

Answer 1

Well yes, that's exactly what HDFS is used for. You can control the replication factor easily if you don't want any duplication, but a replication factor of 2+ is usually recommended to allow for some high availability.