Flink taskmanagers over NAT

Question

I am trying to run Flink cluster over NAT, where the advertised ports will be different from binding ports.

Is there any support for this in Flink?

I looked through the configuration and source code but did not notice anything hinting to NAT being supported. If not, what is the recommended way to achieve this?

Thanks in advance!

Answer 1

It should be possible to connect to a Flink component over NAT.

If the component behind NAT is the JobManager , then you have to configure jobmanager.rpc.address and jobmanager.rpc.port with the values of your logical name and port over which the JobManager is reachable from the outside network.

If the component behind NAT is the TaskManager , then you have to configure taskmanager.host and taskmanager.rpc.port with the values of your logical name and port over which the TaskManager is reachable from the outside network.

Update

At the moment, it is not possible to run Flink over NAT because of FLINK-15911 . The problem is that Flink does not offer separate bind and external port configurations and that the TaskManager tries to resolve taskmanager.host which is not always possible.