简体   繁体   English

Azure 相当于 AWS Athena over s3

[英]Azure Equivalent of AWS Athena over s3

I have an AWS workload that stores csv files in partitions in s3 and then queries the data with SQL queries using Athena, writing the results back to s3.我有一个 AWS 工作负载,它将 csv 文件存储在 s3 的分区中,然后使用 Athena 通过 SQL 查询查询数据,将结果写回 s3。

I'm looking for an equivalent behavior in Azure, where I could store csv files in a storage and query them and write the results back to that storage.我正在寻找 Azure 中的等效行为,我可以在其中将 csv 文件存储在存储中并查询它们并将结果写回该存储。

Based on the information provided on AWS to Azure services comparison , the equivalent service in Azure isAzure Data Lake Analytics .根据AWS to Azure services comparison ,Azure 中的等效服务是Azure Data Lake Analytics For Storage, S3 equivalent service would be Azure Data Lake Storage which is built on top of Azure Blob Storage .对于存储,S3 等效服务将是Azure Data Lake Storage ,它构建在Azure Blob Storage之上。

在此处输入图像描述

The equivalent service to Amazon Athena in Azure will beData Lake Analytics as per this Microsoft doc .根据此Microsoft 文档,Azure 中与 Amazon Athena 的等效服务将是Data Lake Analytics

Also as per this doc The Azure equivalent of Athena is Data Lake Analytics.同样根据文档,与 Athena 等效的 Azure 是 Data Lake Analytics。 Like Athena, it is also "serverless" and pay-per-use.与 Athena 一样,它也是“无服务器”和按使用付费的。 It uses U-SQL, which is a combination of SQL and C# that provides a lot of power and flexibility that SQL alone cannot.它使用 U-SQL,它是 SQL 和 C# 的组合,提供了 SQL 单独无法提供的强大功能和灵活性。 An advantage of Data Lake Analytics is that it is not limited to querying Azure Data Lake Store and Blob Storage, it can also talk to SQL Database and SQL Data Warehouse. Data Lake Analytics 的一个优点是它不仅可以查询 Azure Data Lake Store 和 Blob Storage,它还可以与 SQL Database 和 Z9778840A0100CB30C982876741B0B5AWarehouse 对话。

With Azure Synapse Analytics you can query files with TSQL https://azure.microsoft.com/es-es/products/synapse-analytics/#overview借助 Azure Synapse Analytics,您可以使用 TSQL 查询文件https://azure.microsoft.com/es-es/products/synapse-analytics/#overview

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 AWS Athena Drop Table + S3 位置 - AWS Athena Drop Table + S3 Location 在单独的 AWS 账户中从 Athena 访问 PRIVATE S3 存储桶 - Access PRIVATE S3 bucket from Athena in a separate AWS account 用于清理 Athena OutputLocation 的 AWS S3 生命周期规则 - AWS S3 Lifecycle Rule to cleanup Athena OutputLocation Azure 和 Google Cloud 中的 AWS s3 x-amz-acl header 等价物 - Equivalent of AWS s3 x-amz-acl header in Azure and Google Cloud 即使 AWS s3 中没有文件,AWS Athena 创建外部表也会成功吗? - AWS Athena create external table succeeds even if AWS s3 doesn't have file in it? 如何将 Azure Blob 流式传输到 AWS S3? - How to stream Azure Blob to AWS S3? AWS Athena 从 GLUE Crawler 输入的表中返回零记录来自 S3 - AWS Athena Return Zero Records from Tables Created by GLUE Crawler input csv from S3 如何使用 python 中的 lambda 函数在通过 S3 连接的 AWS athena 中进行查询 - How to query in AWS athena connected through S3 using lambda functions in python AWS Athena 从从 S3 的 GLUE 爬虫输入 csv 创建的表中返回零记录 - AWS Athena Returning Zero Records from Tables Created from GLUE Crawler input csv from S3 如何使用 AWS Athena 读取加密的 delta 格式的 s3 数据集? - How to read encrypted delta formatted s3 datasets using AWS Athena?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM