我的 Foundry 工作使用了多少个执行器？
[英]How many executors is my Foundry job using?
问题描述
I can see the parallelism of my job in the Spark Details page, but I wonder how many Executors my job is actually running with.
我可以在 Spark 详细信息页面中看到我的工作的并行性，但我想知道我的工作实际上与多少个 Executor 一起运行。
Where can I see this?我在哪里可以看到这个？
1 个解决方案
解决方案1
2 2022-01-31 22:03:29
If you follow the same methodology to find the Environment tab noted over here , you'll find an entry on that page for the number of executors used.如果您按照相同的方法找到此处提到的“ Environment ”选项卡，您将在该页面上找到一个条目，说明使用的执行器数量。
Depending on your environment, you may find that dynamicAllocation is true , in which case you'll have a minExecutors and a maxExecutors setting noted, which is used as the 'bounds' of your job.根据您的环境，您可能会发现dynamicAllocation为true ，在这种情况下，您将记录一个minExecutors和一个maxExecutors设置，用作工作的“界限”。 You'll have any number of executors in that range depending on if you're using static allocation or dynamic allocation .根据您使用的是static 分配还是动态分配，您将拥有该范围内的任意数量的执行程序。
If dynamicAllocation is false , then you'll see an executorInstances entry, with the count listed there.如果dynamicAllocation为false ，那么您将看到一个executorInstances条目，其中列出了计数。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.