如何使用 TinkerPop/Gremlin 处理图形数据的大型 .kryo 文件

Question

I am new to Apache TinkerPop. I have done some basic stuff like installing TinkerPop Gremlin console, creating graph .kryo file, loaded it in gremlin console and executed some basic gremlin queries. All good till now.

But i wanted to check how can we process .kryo files which are very much large in size says more than 1000GB. If i create a single .kryo file, loading it in console(or using some code) is not feasible i think.

Is there any way we can deal with graph data which is pretty huge in size? basically i have some graph based data stored in Amazon Neptune DB, i want to take it out and store it in some files(eg .kryo) and process later for gremlin queries. Thanks in advance.

Answer 1

Rather than use Kyro which is Java specific, I would recommend using something more language agnostic such as CSV files. If you are using Amazon Neptune you can use the Neptune Export tool to export your data as CSV files.

• Documentation
• Git repo
• Cloud Formation template