如何在 Jar class（在 Scala 中）中定义多个主要方法并从 Azure 数据工厂调用它？

Question

I am looking to create Jar file class which contains multiple main class methods(in Scala) so Azure data factory activity can call jar activity. Azure data factory requires main class name and parameters.

Regards Rajaniesh

Answer 1

In Azure Data Factory, Jar files can contain only one Main-Class attribute in the manifest, which means a jar can contain only one mainClassName.

Here is the sample JSON definition of a Databricks Jar Activity:

{
    "name": "ADB-Jar-Activity",
    "properties": {
        "activities": [
            {
                "name": "Jar1",
                "type": "DatabricksSparkJar",
                "dependsOn": [],
                "policy": {
                    "timeout": "7.00:00:00",
                    "retry": 0,
                    "retryIntervalInSeconds": 30,
                    "secureOutput": false,
                    "secureInput": false
                },
                "userProperties": [],
                "typeProperties": {
                    "mainClassName": "org.apache.spark.examples.SparkPi",
                    "parameters": [
                        "10",
                        "20"
                    ],
                    "libraries": [
                        {
                            "jar": "dbfs:/docs/sparkpi.jar"
                        }
                    ]
                },
                "linkedServiceName": {
                    "referenceName": "ADB",
                    "type": "LinkedServiceReference"
                }
            }
        ],
        "annotations": []
    }
}

Reference: Transform data by running a Jar activity in Azure Databricks .