如何從flink cassandra連接器中排除cassandra數據stax驅動程序

Question

我在cassandra sink相關代碼中遇到了運行時異常：

07/16/2018 17:09:48 Job execution switched to status FAILING.
java.lang.NoSuchMethodError: com.datastax.driver.core.BoundStatement.set(ILjava/lang/Object;Lorg/apache/flink/cassandra/shaded/com/google/common/reflect/TypeToken;)Lcom/datastax/driver/core/BoundStatement;

我還有另一個依賴項，該依賴項還使用了datastax驅動程序以及cassandra-flink連接器。

我試圖從flink cassandra連接器中排除datastax驅動程序，但未按預期工作

我的SBT依賴關系如下所示：

val datafeedsDeltaStreamDeps: Seq[ModuleID] = commonDependencies ++ flinkDeps ++ Seq(

    "org.apache.flink" %% "flink-connector-cassandra" % "1.4.1"  excludeAll ExclusionRule(organization = "com.datastax"), <<< I tried to exclude the data stax from the flink cassandra connector

    "com.dy.productfeed" %% "feedsinterface" % "0.4.0", << this also has a cassandra dependency in it
    CommonDependencies.statsdClient
  )

但是我仍然在flink包下看到“ cassandra”驅動程序

Answer 1

DataStax庫在Flink-Cassandra-connector.jar中帶有陰影，因此您不能排除它。 如果需要特定的DataStax版本，則可以使用以下命令針對該版本構建Flink源：

directory: flink-connectors/flink-connector-cassandra
command: mvn package -Ddriver.version=3.1.4