Azure Synapse Spark Pool 提交失败并显示错误消息“SparkJobDefinitionActionFailed”

Question

I am following the tutorials below and try to submit a Spark Job using the Spark engine in Azure Synapse.

The submission failed with following error:

Error:
{
  "code": "SparkJobDefinitionActionFailed",
  "message": "Spark job batch request for workspace contosows, spark compute contosospark with session id null failed with a system error. Please try again",
  "target": null,
  "details": null,
  "error": null
}

Can anyone give some guidance/suggestions on how to resolve it?

More information about my setups.

1. Region: Southeast Asia for both Azure Synapse workspace + ADLS Gen2
2. I grant myself Both Storage Blob Data Owner and Storage Blob Data Contributor roles as suggested.
3. Tutorials used:

• https://docs.microsoft.com/en-us/azure/synapse-analytics/quickstart-create-workspace
• https://docs.microsoft.com/en-us/azure/synapse-analytics/quickstart-create-apache-spark-pool-portal
• https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-job-definitions

Thanks!

Answer 1

After investigation, the product group deployed a hotfix to fix this problem.

Now you can submit the Spark job without any issues. Please do let me known, if you are experiencing this issue anymore.