错误：对象 Stemmer 不是包 org.apache.spark.mllib.feature 的成员

Question

Importing the package org.apache.spark.mllib.feature.Stemmer in Spark-shell using Scala returns the following error: :47: error: object Stemmer is not a member of package org.apache.spark.mllib.feature import org.apache.spark.mllib.feature.Stemmer

I am trying to use stemming to my words using:

val stemmer_product_title = new Stemmer()
  .setInputCol("ngrams")
  .setOutputCol("stemmed")
  .setLanguage("English")

Here ngrams is a 1-gram transformed text. Could anyone help me with this please? I would be grateful.

Answer 1

Add the following dependency to your pom.xml

<dependency>
    <groupId>com.github.master</groupId>
    <artifactId>spark-stemming_2.10</artifactId>
    <version>0.2.0</version>
</dependency>

or to your build.sbt

libraryDependencies += "com.github.master" %% "spark-stemming" % "0.2.1"