AWS Glue Python shell 配置 DPU
[英]AWS Glue Python shell Configuration DPU
问题描述
does 1 dpu setting change when I use glue python shell instead of glue spark?.
当我使用胶水 python shell 而不是胶水火花时，1 dpu 设置会改变吗？ I recently saw a post Maximum number of concurrent tasks in 1 DPU in AWS Glue and I saw they were talking about glue spark, but not from aws glue python shell, that's why I have that doubt.我最近在 AWS Glue 中看到了 1 个 DPU 中的最大并发任务数，我看到他们在谈论胶水火花，但不是来自 aws 胶水 python shell，这就是为什么我有这个疑问。
1 个解决方案
解决方案1
2 已采纳 2020-08-12 15:49:19
As per this doc an AWS Glue job of type Python shell can be allocated either 1 DPU or 0.0625 DPU.By default, AWS Glue allocates 0.0625 DPU to each Python shell job. As per this doc an AWS Glue job of type Python shell can be allocated either 1 DPU or 0.0625 DPU.By default, AWS Glue allocates 0.0625 DPU to each Python shell job.
You are billed $0.44 per DPU-Hour in increments of 1 second, rounded up to the nearest second, with a 1-minute minimum duration for each job of type Python shell.您需要支付每 DPU 小时 0.44 美元的费用，增量为 1 秒，四舍五入到最接近的秒数，每个 Python shell 类型的作业的最短持续时间为 1 分钟。
A single DPU provides processing capacity that consists of 4 vCPUs of compute and 16 GB of memory as per this .单个 DPU 提供的处理能力由 4 个 vCPU 的计算和 16 GB 的memory组成。
At max you can provide 1 DPU as it doesn't need many resources because there is no distributed processing involved.最多可以提供 1 个 DPU，因为它不需要很多资源，因为不涉及分布式处理。 You try giving more than 1 DPU and will encounter error as shown below:您尝试提供超过 1 个 DPU 并会遇到如下所示的错误：
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.