简体   繁体   English

Flink多槽TaskManagers最佳实践

[英]Flink multi slot TaskManagers best practice

Say one is running a cluster set to parallelism > 1. What is the best practice for configuring the number of task slots in a task manager? 假设一个运行集群设置为并​​行> 1.在任务管理器中配置任务槽数的最佳做法是什么?

  • Run multiple TM with a single task slot per each 使用每个单个任务槽运行多个TM
  • Run a single/few TM with multiple task slots 运行带有多个任务槽的单个/少数TM

We are running a Flink cluster with version 1.6.3. 我们正在运行版本为1.6.3的Flink集群。 Flink 1.7 release notes states that "Flink now properly supports TaskManagers with multiple slots". Flink 1.7发行说明指出“Flink现在正确支持具有多个插槽的TaskManagers”。 Is it recommended to start them with a single slot in previous versions? 是否建议在以前的版本中使用单个插槽启动它们?

With Flink 1.5 and 1.6, except when running with legacy mode turned on (via mode: legacy ), the allocation of TaskManagers with multiple slots is not fully supported and it is recommended to set taskmanager.numberOfTaskSlots: 1 . 使用Flink 1.5和1.6时,除了在打开传统模式(通过mode: legacy )的情况下运行时,不完全支持具有多个插槽的TaskManagers的分配,建议设置taskmanager.numberOfTaskSlots: 1 Now that the refactoring of the runtime known as FLIP-6 has been completed, this restriction has been lifted. 现在已经完成了称为FLIP-6的运行时的重构,这个限制已被取消。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM