[英]what is the better way to index data from Oracle/relational tables into elastic search?
What are the options to index large data from Oracle DB to elastic search cluster? 将大数据从Oracle DB索引到弹性搜索集群有哪些选项? Requirement is to index 300Million records one time into multiple indexes and also incremental updates having around approximate 1 Million changes every day.
要求是将300Million记录一次索引到多个索引中,并且还增量更新每天大约有大约1百万个更改。
I have tried JDBC plugin for elasticsearch river/feeder , both seems to be running inside or require locally running elastic search instance. 我已尝试过弹性搜索河/馈线的 JDBC插件,两者似乎都在内部运行或需要本地运行的弹性搜索实例。 Please let me know if there is any better option for running elastic search indexer as a standalone job (probably java based).
如果有更好的选择将弹性搜索索引器作为独立作业(可能是基于java的)运行,请告诉我。 Any suggestions will be very helpful.
任何建议都会非常有帮助。 Thanks.
谢谢。
We use ES as a reporting db and when new records are written to SQL we take the following action to get them into ES: 我们使用ES作为报告数据库,当新记录写入SQL时,我们采取以下操作将它们引入ES:
This process works great because it handles both new data and old data. 此过程非常有效,因为它可以处理新数据和旧数据。 For old data just write a quick script to write 300M primary keys into rabbit and you're done!
对于旧数据,只需编写一个快速脚本,将300M主键写入兔子,就完成了!
there are many integration options - I've listed out a few to give you some ideas, the solution is really going to depend on your specific resources and requirements though. 有很多集成选项 - 我已经列出了一些给你一些想法,但解决方案实际上将取决于你的具体资源和要求。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.