简体   繁体   English

从 Azure Databricks 将数据写入 Azure Blob 存储

[英]Writing Data to Azure Blob Storage from Azure Databricks

I was able to mount Azure Blob Container to my Databricks DBFS and was able to read the data as well.我能够将 Azure Blob 容器挂载到我的 Databricks DBFS,并且还能够读取数据。 While writing, I was able to see the files in the mount point from within databricks, however, it does not reflect in the blob storage.在编写时,我能够从 databricks 中看到挂载点中的文件,但是,它不会反映在 blob 存储中。 Can someone help?有人可以帮忙吗?

Are you saving the data frame?你在保存数据框吗?

df.write
.option("header", "true")
.format("com.databricks.spark.csv")
.save("/mnt/result/someData.csv")

Chances are that your path is incorrect.您的路径可能不正确。 Check the mounted path with dbutils.fs.mounts() and ensure it is in your saving path.使用dbutils.fs.mounts()检查安装路径并确保它在您的保存路径中。 Also check that your saving path starts with dbfs:/ and not /dbfs/ .还要检查您的保存路径是否以dbfs:/而不是/dbfs/ Don't hesitate to share your script.不要犹豫,分享您的脚本。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 使用 Databricks 将文件从 Azure Blob 存储上传到 SFTP 位置? - Uploading files from Azure Blob Storage to SFTP location using Databricks? 数据砖列出Azure Blob存储中的所有Blob - Databricks list all blobs in Azure Blob Storage 运行Spark群集的Azure Databricks中需要Azure Blob存储 - Need for Azure Blob Storage in Azure Databricks running Spark clusters 将数据从广播变量 (databricks) 写入 azure blob - Write data from broadcast variable (databricks) to azure blob 从Azure数据块到Azure表存储的Connectiong - Connectiong to Azure table storage from Azure databricks 如何将 a.hyper 文件(在 DataBricks 中)写入 Blob 存储(在 Azure 中)? - How to Write a .hyper file (in DataBricks) to Blob Storage (in Azure)? 使用 Databricks PySpark 从 Azure blob 存储读取多个 CSV 文件 - Reading multiple CSV files from Azure blob storage using Databricks PySpark Databricks:将文件从 Azure Blob 存储上传到另一个位置而不在本地复制 - Databricks: Uploading a file to another location from Azure Blob Storage without copying it locally 来自 Databricks 的文件元数据,例如 timein Azure 存储 - File metadata such as timein Azure Storage from Databricks Azure 从 Blob 存储中抓取数据 w。 Python(无需下载) - Azure Grab Data from Blob Storage w. Python (No downloading)
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM