Serving Univeral Sentence Encoder Model using tensorflow serving and docker

Question

I have universal sentence encoder model saved on my local drive. I am trying to serve the model on docker container using tensorflow serving.

Command:

sudo docker run -p 8502:8502 --name tf-serve -v /home/ubuntu/first/models:/models -t tensorflow/serving --model_base_path=/models/test

where /home/ubuntu/first/models is the folder path to my model files.

After running initially it is going into an infinite loop.

What is happening here?. Any help will be appreciated.

Answer 1

edit your command like this:

sudo docker run -p 8502:8502 --name tf-serve -v /home/ubuntu/first/models:/models/test -t tensorflow/serving --model_base_path=/models/test

your --model_base_path is /models/test so you need to copy the files into that folder in your -v