从头开始模仿 HDFS（Hadoop 分布式文件系统）

Question

I want to create my own mini-HDFS setup on my system, complete with the architectural structure consisting of Data Nodes and Name Nodes and replication of data across nodes using python. Could anyone help me with some resources for doing this?

Answer 1

You can use Raft Protocol. This is my implemention for this protocol: https://github.com/Ehsan2754/Fall2021/tree/main/DPN/Lab8 you can pretty much see the way it works in my documents in my repo. here is a interactive way to tell you how this protocol works. http://thesecretlivesofdata.com/raft/