how can I configure mongoDB for nutch?

Question

Recently I try to finish a web-spider, I use nutch-1.10, I want to load data into mongoDB, which data gotten by nutch/crawl, I don't how to configure mongoDB for nutch, I can't find relative materials. I know that from the some blogs that nutch2.x is must while 1.x can not achieve my purpose! But the details for configuring still unclear to me! Can someone clear that!Thank you!

Answer 1

Nutch 2.x support for MongoDB is not for storing extracted and structured result but to store nutch's internal database in MongoDB.

Currently, nutch supports pushing data to Apache Solr, Elasticsearch and Amazon Cloud service. If you want to push the data to MongoDB, then you need to create a new indexer plugin. Look at indexer-elastic or indexer-solr to understand how to write a new indexer plugin.