What's the logic behind requesting more executors than machines available in your cluster?
In the ideal situation, we would like to have 1 executor (=1 jvm) at each of our machines, and not few in each machine.
If not, then why?
Thanks in advance
In the ideal situation, we would like to have 1 executor (=1 jvm) at each of our machines, and not few in each machine.
Not necessarily. Depending on the amount of available memory and JVM implementation separate virtual machines can be much a better option, in particular to:
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.