如何使用lucene进行词形还原和消除空的法语单词

Question

我正在寻找lemmatizate和用法语中使用lucene用法语写的文件中的空话来消除我在互联网上看到的但是我没有找到好的tutoriels。

Answer 1

The term for "empty words" is stop words .

Lucene provides the FrenchAnalyzer class, which comes with a default stop words list for the French language.

Just use that class as your analyzer.

Answer 2

It's easy, all what you need is a FrenchAnalyzer like this:

IndexWriterConfig conf= new IndexWriterConfig (Version.LUCENE_45,new FrenchAnalyzer(Version.LUCENE_45,FrenchAnalyzer.getDefaultStopSet()));

and for empty words we use : FrenchAnalyzer.getDefaultStopSet() like i did in the previous code , and for the lemmatization it's already integrated in this analyzer and you can notice that when you look for the important words (by tf idf) .