Spark 在 Azure 数据工厂中提交

Question

我们如何在 Azure 数据工厂中集成 spark-scala JAR？ 我有一个现有的 Spark Jar 用 Scala 构建，我需要从 ADF 调用它 - Spark Activity。

Answer 1

Note: In Azure Data Factory the entryFile must be either a Python or a jar file , you would need to compile your Scala source code to jar file before running it as spark applications.

参考： https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-spark