简体   繁体   English

查询 Athena 哪个更快:pyathena 或 boto3?

[英]Which one is faster for querying Athena: pyathena or boto3?

Which one is faster pyathena or boto3 to query AWS Athena schemas using python script?使用 python 脚本查询 AWS Athena 模式时, pyathenaboto3哪一个更快?

Currently I am using pyathena to query Athena schemas but it's quite slow and I know there is another option of boto3 but before starting need some experts advice.目前我正在使用 pyathena 来查询 Athena 模式,但它很慢,我知道 boto3 有另一种选择,但在开始之前需要一些专家的建议。

Looking at the dependencies for PyAthena you can see that it actually have a dependency of boto3. 查看 PyAthena依赖项,您可以看到它实际上具有 boto3 的依赖项。

Unless PyAthena has added a lot of overhead to its library which is unlikely, the best performance improvements you're likely to see will depend on how you're using Athena itself.除非 PyAthena 为其库增加了大量开销(这是不太可能的),否则您可能看到的最佳性能改进将取决于您如何使用 Athena 本身。

There are many performance improvements you can make, Amazon published a blog named Top 10 Performance Tuning Tips for Amazon Athena which will help to improve the performance of your queries.您可以进行许多性能改进,亚马逊发布了一篇名为Amazon Athena 的十大性能优化技巧的博客,这将有助于提高您的查询性能。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM