Java中的Spark MLlib不起作用

Question

My problem is that I have downloaded Apache Spark for java and create a dependency:

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-core_2.11</artifactId>
    <version>2.3.0</version>
</dependency>

Everything works fine, but I cannot import MLlib from Apache Spark. I tried for example:

import org.apache.spark.ml.linalg.Vectors;

But I have a message "Cannot resolve symbol 'ml'". What is the solution for this problem?

Answer 1

You have to add Apache Spark MLLib dependency in your maven file

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-mllib_2.11</artifactId>
    <version>2.3.0</version>
</dependency>