事件中心与Azure Databricks的连接

Question

I want to add libraries in Azure Databricks for connecting to Event Hubs. I will be writing notebooks in python. So which library should I add for connecting to Event Hubs?

As per my search till now I got a spark connecting library in Maven coordinates. But I don't think I will be able to import it in python.

Answer 1

Structured streaming integration for Azure Event Hubs is ultimately run on the JVM, so you'll need to import the libraries from the Maven coordinate below:

 groupId = com.microsoft.azure
  artifactId = azure-eventhubs-spark_2.11
  version = 2.3.10

Note: For Python applications, you need to add this above library and its dependencies when deploying your application.

For more details, refer " Structured streaming + Event Hubs Integration Guide for PySpark " and " Attach libraries to Spark Cluster ".

And also, you may refer SO thread, which addresses a similar issue.

Hope this helps.