Apache Solr 标记器

Question

I am using Apache Solr as my semantic search engine. In which users can type anything and I have to retrieve using relevant results using words.

I want to split string in tokens.

Example: "actorsfrommumbai" -> "actors from mumbai"

How can I achieve this feature in solr ?

Answer 1

看起来你正在寻找解压缩 - > https://wiki.apache.org/solr/LanguageAnalysis#Decompounding这使你有可能搜索复合词的一部分。

Answer 2

There is a possibility in solr to configure analyser for decompounding based on dictionary provided. You will have to configure analyser something like this

 <analyzer>
 <tokenizer class="solr.StandardTokenizerFactory"/>
 <filter class="solr.DictionaryCompoundWordTokenFilterFactory"
 dictionary="abc.txt"/>
 </analyzer>

abc.txt is the dictionary.

Note that the analyser apply both at index as well as query time.

Answer 3

You can try using Ngram and EdgeNgram filter and tokenizers available in solr. Because it is a single word and it can only be split with these two since you can not use delimiter here.