Spark 在 Azure 數據工廠中提交

Question

我們如何在 Azure 數據工廠中集成 spark-scala JAR？ 我有一個現有的 Spark Jar 用 Scala 構建，我需要從 ADF 調用它 - Spark Activity。

Answer 1

Note: In Azure Data Factory the entryFile must be either a Python or a jar file , you would need to compile your Scala source code to jar file before running it as spark applications.

參考： https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-spark