简体繁体 English

如何使用 Airflow 将 CSV 文件从 Azure Data Lake/Blob 存储传输到 PostgreSQL 数据库

[英]How to transfer a CSV file from Azure Data Lake/Blob Storage to PostgreSQL database with Airflow

原文 2022-04-21 19:00:19 9 1 postgresql/ csv/ airflow/ azure-blob-storage/ azure-data-lake-gen2

devs.开发人员。

I am sorry to bother you guys, but I would like to know how to transfer a CSV file from Azure Data Lake/Blob Storage to the PostgreSQL database with Airflow?很抱歉打扰你们，但我想知道如何使用 Airflow 将 CSV 文件从 Azure Data Lake/Blob Storage 传输到 PostgreSQL 数据库？

Thanks a lot,非常感谢，

Rodrigo罗德里戈

1 个解决方案

Using Azure hook you are able to do that使用 Azure 钩子你可以做到这一点

You will need crate a connection and configure it您将需要创建一个连接并对其进行配置

Reference for Azure hook: Azure挂钩参考：

https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/wasb/index.html https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/stable/_api/airflow/providers/microsoft/azure/hooks/wasb/index.html

azure 数据湖客户端与 azure blob 客户端有何不同 - how azure data lake client different from azure blob client

如何从存储在Azure blob存储中的json文件中获取数据 - How to get data from json file stored in Azure blob storage in react

从存储帐户（Azure Data lake）读取 pdf 文件，无需使用 python 下载 - Read pdf file from storage account (Azure Data lake) without downloading it using python

从 azure blob 存储中获取文件名 - Get file names from azure blob storage

Azure 存储 Blob：上传的 CSV 文件显示零字节 - Azure Storage Blob: Uploaded CSV file shows zero bytes

将 CSV 从 Azure Automation 导出到 Microsoft Teams 而不是 blob 存储？ - Export a CSV from Azure Automation to Microsoft Teams instead of blob storage?

Azure function C#：写入 Azure 上的块 blob（csv 文件）存储帐户创建了两个版本的 blob - Azure function C#: Writing to Block blob (csv file) on Azure Storage Account creates two versions of the blob

如何将数据库连接到 Azure Blob 中的数据文件？ - How to connect database to data files in Azure Blob?

直接从浏览器上传文件到 Azure Blob 存储？ - Upload file to Azure Blob Storage directly from browser?

如何将 BigQuery 视图作为 csv 文件传输到 Google Cloud Storage 存储桶 - How to Transfer a BigQuery view to a Google Cloud Storage bucket as a csv file

暂无

暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 azure 数据湖客户端与 azure blob 客户端有何不同 - how azure data lake client different from azure blob client 如何从存储在Azure blob存储中的json文件中获取数据 - How to get data from json file stored in Azure blob storage in react 从存储帐户（Azure Data lake）读取 pdf 文件，无需使用 python 下载 - Read pdf file from storage account (Azure Data lake) without downloading it using python 从 azure blob 存储中获取文件名 - Get file names from azure blob storage Azure 存储 Blob：上传的 CSV 文件显示零字节 - Azure Storage Blob: Uploaded CSV file shows zero bytes 将 CSV 从 Azure Automation 导出到 Microsoft Teams 而不是 blob 存储？ - Export a CSV from Azure Automation to Microsoft Teams instead of blob storage? Azure function C#：写入 Azure 上的块 blob（csv 文件）存储帐户创建了两个版本的 blob - Azure function C#: Writing to Block blob (csv file) on Azure Storage Account creates two versions of the blob 如何将数据库连接到 Azure Blob 中的数据文件？ - How to connect database to data files in Azure Blob? 直接从浏览器上传文件到 Azure Blob 存储？ - Upload file to Azure Blob Storage directly from browser? 如何将 BigQuery 视图作为 csv 文件传输到 Google Cloud Storage 存储桶 - How to Transfer a BigQuery view to a Google Cloud Storage bucket as a csv file

相关标签

粤ICP备18138465号 © 2020-2024 STACKOOM.COM