使用Spark测试基础时Spark单元测试编译错误

Question

我收到以下错误

Error:scalac: bad symbolic reference. A signature in DataFrameSuiteBaseLike.class refers to term hive
in package org.apache.spark.sql which is not available.
It may be completely missing from the current classpath, or the version on
the classpath might be incompatible with the version used when compiling  
DataFrameSuiteBaseLike.class

Answer 1

您应该将Spark Hive库添加到依赖项中。 例如在SBT中：

libraryDependencies += "org.apache.spark" % "spark-hive_2.10" % "1.6.1"

这在项目中提到： https：//github.com/holdenk/spark-testing-base/issues/93