Spark cassandra connector Java API with Spark 2.0

Question

I am using the datastax spark cassandra connector with Spark 1.6.3.

Is it possible to use the Spark cassandra connector Java API with Spark 2.0+?

I see that the latest version of spark-cassandra-connector-java_2.11 is 1.6.0-M1.

Does someone know about the future of the connector's Java API?

Thanks,

Shai

Answer 1

If you're running Spark 2.0-2.2, you can use Cassandra connector from DataStax https://spark-packages.org/package/datastax/spark-cassandra-connector (which is written in Scala, but you can just consume jar).

Check out the compatibility table in the official repo: https://github.com/datastax/spark-cassandra-connector#version-compatibility