Traefik：负载均衡内部服务而不将其暴露在外面

Question

Currently, I have a frontend , backend , and tf-serving service. My current configuration exposes both frontend and backend services outside.

The service tf-serving , however, is an internal service only used by the backend service. They communicate using the gRPC API provided by TensorFlow Serving.

Would it be possible for tf-serving to be load balanced too such that when I call it from the backend service, Traefik will load balance it for me?

Answer 1

Yes, it is possible. A better approach however, is to connect tf-serving service to the same network as your backend service (or create a separate network just for the two of them) and connect to it directly from backend using container name dns resolving.