Can we use Shark 0.9.1 version with Spark 1.1.0?

Question

I know Shark has been subsumed by Spark SQL, a new module in Apache Spark. But my question is, can we use the existing Shark with new Spark versions ?

Answer 1

According to its release notes , Shark 0.9.1 only supports Spark 0.9.1.

According to a mailing list post , there is not an official version of Shark for Spark 1.0+. Shark depends on non-public interfaces of Spark that have likely changed between 0.9.1 and 1.1.0, so it may be a significant amount of work to port Shark to Spark 1.0+.