Create a Solr Index using Lucene IndexWriter

Question

I need to index vast amounts of content in extremely short order, I have tried various techniques using Solrnet/solr using threading and TPL, however the speeds leave a lot to be desired. Hence considering a move to using Lucene.net index writer to create an index (preliminarily I see almost an order of magnitude of speed improvement) . Any "gotchas" to be aware of?

I am not too sure if: 1. Trie based Numeric Range query would continue to be available for query via Solr. ( I am using NumericFields in Lucene)? 2. Faceting etc. would continue to be available ?

Anything else I need to watch out for?

Answer 1

Please see Scaling Lucene and Solr about improving run times.

If you decide to go with Lucene:

• You need a unique id field for the index to be a valid Solr index.
• The schema must match the Solr schema.
• The Lucene version must be the same as in Solr.
• I think the range query and faceting will be available, as long as you index the respective fields according to the requirements in Solr, and use the same analyzers.