如何将PDF文件从HDFS索引到Solr

Question

I am new to Apache solr I have a requirement in my project where I have to upload pdf documents from HDFS to Solr and from there I want to get using Solr rest API's. I have total 40k pdf documents in my local file system, first I will push them to HDFS. But from there to Solr I really don't have any idea

Another thing is while indexing into solr, i want to read some data from pdf document and index that data also into Solr. Example: I want extraxt candidate name, candidate location from pdf document and push them into solr schema which looks like,

name: "candidate_name"
location: "candidate_location"
document: "pdf_document"

I searched for this over the internet, but couldn't find the right solution

Answer 1

Try using the https://github.com/lucidworks/hadoop-solr

You should try the DirectoryIngestMapper, it has Tika parsing, but you will have to customized it.