简体   繁体   English

水槽或卡夫卡相当于mongodb

[英]flume or kafka's equivalent to mongodb

In Hadoop world, flume or kafka is used to streaming or collecting data and store them in Hadoop. 在Hadoop世界中,flume或kafka用于流式传输或收集数据并将其存储在Hadoop中。 I am just wondering that does Mango DB has some similar mechanisms or tools to achieve the some? 我只是想知道Mango DB是否有一些类似的机制或工具来实现一些?

MongoDB is just the database layer, not the complete solution like the Hadoop ecosystem. MongoDB只是数据库层,而不是像Hadoop生态系统那样的完整解决方案。 I actually use Kafka along with Storm to store data in MongoDB in cases where there is a very large flow of incoming data which needs to be processed and stored. 我实际上使用Kafka和Storm在MongoDB中存储数据,以防需要处理和存储大量的传入数据。

Although Flume is frequently used and treated as a member of the Hadoop ecosystem, it's not impossible to use it with other sources/sinks. 尽管Flume经常被用作Hadoop生态系统的一员,但它与其他来源/接收器一起使用并非不可能。 MongoDB is not an exception. MongoDB也不例外。 In fact, Flume is flexible enough to be extended to create your own custom sources/sinks. 实际上,Flume足够灵活,可以扩展到创建自己的自定义源/接收器。 See this project , for example. 例如,请参阅此项目 This is a custom Flume-Mongo-sink. 这是一个定制的Flume-Mongo-sink。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM