简体   繁体   English

带有 ADF 的数据块或函数?

[英]Databricks or Functions with ADF?

I'm using ADF to output some reports to pdf (at least that's the goal.)我正在使用 ADF 将一些报告输出为 pdf(至少这是目标。)

I'm using ADF to output a csv to a storage blob and I would like to ingest that, do some formatting and stats work (with scipy and matplotlib in python) and export as a pdf to the same container.我正在使用 ADF 将 csv 输出到存储 blob,我想摄取它,做一些格式化和统计工作(在 python 中使用 scipy 和 matplotlib)并作为 pdf 导出到同一个容器。 This would be run once a month, and I may do a few other things like this, but they are periodical reports at the most, no streaming or anything like that.这将每月运行一次,我可能会做一些其他类似的事情,但它们最多是定期报告,没有流媒体或类似的东西。

From an architectural stand point, would this be a good application for an Azure Function (which I have some experience), or Azure Databricks (which I will want some experience in).从架构的角度来看,这是否是 Azure Function(我有一些经验)或 Azure Databricks(我需要一些经验)的好应用程序。

My first thought is the Azure Functions, since they are serverless and pay-as-you-go.我的第一个想法是 Azure Functions,因为它们是无服务器且即用即付的。 But I don't know too much about Databricks except that it's primarily used for big data and long running jobs.但我对 Databricks 知之甚少,只知道它主要用于大数据和长时间运行的作业。

Databricks would be almost certainly an overkill for this.对此,Databricks 几乎可以肯定是一种矫枉过正。 So yes, Azure Function for Python sounds like a perfect fit for your scenario.是的,适用于 Python 的 Azure 函数听起来非常适合您的方案。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 Databricks/ADF python 帮助 - Databricks/ADF python assistance Databricks + ADF + ADLS2 + Hive = Azure Synapse - Databricks + ADF + ADLS2 + Hive = Azure Synapse 使用 Databricks 和 ADF 展平复杂的 json - Flatten complex json using Databricks and ADF 如何使用 Databricks Activity 在 ADF 上实施 DevOps - How to implement DevOps on ADF with Databricks Activity 无法将 databricks 笔记本的 output 检索到 ADF - Unable to retrieve output of databricks notebook to ADF 使用 ADF 将数据传输到 Databricks 表期间的数据类型转换为字符串 - Data type during transferring data with ADF to Databricks tables converts into string 如何在 ADF 或 Databricks 中将 ADLS gen2 文件夹/文件名动态传递给 Databricks Notebook - How to dynamically pass ADLS gen2 folder/filename to Databricks Notebook in ADF or Databricks ADF 数据块 python 活动从 blob 存储而不是 dbfs 中选择 python 脚本 - ADF databricks python activity to pick python script from blob storage not from dbfs 如何使用 Azure 数据工厂 - Databricks 中的 continuation_token 获取 ADF 管道运行详细信息的下一页? - How to get next Page of ADF Pipeline run details using continuation_token in Azure Data Factory - Databricks? Azure 数据工厂(ADF)与 Azure Functions:如何选择? - Azure Data Factory(ADF) vs Azure Functions: How to choose?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM