将数据（2-3 GB）定期加载到在Kubernetes集群上运行的Apache Ignite集群的最佳方法

Question

The data needs to be loaded periodically (like once in a day), and it should be stored in SQL format so that the API can run SQL queries. We are thinking of loading it from HDFS. Currently we are thinking of using Apache Nifi using PutIgniteCache.

I was thinking probably I can launch a remote Ignite client node and then use IgniteDataStreamer to stream the data, but I was not able to find proper documentation for that. Are there any better ways to do this?

Answer 1

Nifi的文档说它使用了数据流API ，因此，除非您需要更多控制，否则它似乎不是一个坏选择（我要警告的是，在不多使用Nifi之前我从未听说过Nifi！）。