Im trying to use dbutils in scala spark. Im submitting this job on databricks using spark submit. But, Im getting null pointer exception. I have ad ...

I'm trying to open same project in 3 build tools: Maven, Ant and Gradle. It's simple project with sql database, I've already done this via Ant and Mav ...

Is there any possibility to retrieve Databricks Instance Id (the blurred piece of URL) by executing some code in the notebook cell? ...

I mounted a blob storage container (confirmed blob type): The mount point is created and I can see it in databricks. I placed a csv file in this co ...

What do I need to do if I want to achieve similar functions? Especially in precise=false, how is it roughly calculated? see: https://docs.databrick ...

Can I iterate through the widgets in a databricks notebook? Something like this pseudocode? # NB - not valid inputs = {widget.name: widget.value for ...

I'm calling a notebook like this: dbutils.notebook.run(path, timeout, arguments) where arguments is a dictionary containing many fields for the not ...

I'm trying to package my jar based off of code in a databricks notebook. I have the following line that works in databricks but is throwing an error ...

I am using the below command in Azure Databricks to try and copy the file test.csv from the local C: drive to the Databricks dbfs location as shown. ...

On Databricks I would like to install a Maven library through commands in a Python Notebook if its not already installed. If it were a Python PyPI li ...

I want to call using mirroring. So far I achieve this: This delivers a valid dbutils reference: As comparison: To list the available fiel ...

Trying to read delta log file in databricks community edition cluster. (databricks-7.2 version) Getting file not found error: I have tried w ...

I am currently using Python's Threading to parallelize the execution of multiple Databricks notebooks. These are long-running notebooks, and I need to ...

I would like to read a parquet file in Azure Blob, so I have mount the data from Azure Blob to local with dbultils.fs.mount But I got the errors Exce ...

I export my databricks workspace directory (/Users/xyz/) contents which has several python notebooks and scripts onto a databricks specific location f ...

I am running pyspark from an Azure Machine Learning notebook. I am trying to move a file using the dbutil module. I got this error: ModuleNotFoundE ...

Is it possible to get the time when file was opened last time as like ls -ltu list all the files, showing and sorting by access time in Unix by using ...

I try to check if the path exists in Databricks using Python: If the path does not exist, I expect that the except statement executes. However, ins ...

I have a set of values to return as output from my databricks notebook. Can anyone sugggest a way to do that in an efficient and easy way? ...

Would like to run a local Jupiter notebook connecting to Azure databricks cluster, and need to use dbutils to get secrets. This requires to save a pri ...