使用REST API和SSL自身证书的Tensorflow服务GPU

Question

I am trying to install TensorFlow-gpu with REST API in Centos 7 Docker container. But I am unable to find an exact procedure for this. Do I need to install following dependencies?

• I have installed cuda 9.0
• cdDNN 7.4
• NCCL 2.x

Answer 1

I haven't started yet to build tensorflow serving using GPU. I m in the middle of research stage ~ in this process in every article showing related to Ubuntu installation and m trying to install.in centos 7 .. so I don't have any docker file ..

Hope this may help you and me to get solution .

Answer 2

Here is what I use to build a tensorflow-serving-runtime docker image.

FROM nvidia/cuda:9.0-cudnn7-runtime-centos7

ARG TF_VERSION=1.9.0

RUN yum install -y  \
    yum-plugin-ovl \
    libgomp \
    ca-certificates \
    zip \
    unzip \
    curl \
        && \
    yum clean all

WORKDIR /usr/
RUN curl -sSL -o /usr/nccl_2.2.13-1-cuda9.0_x86_64.tgz http://some-of-my-net-disk/tensorflow-serving/lib/nccl_2.2.13-1-cuda9.0_x86_64.tgz && \    # Change your way to get nccl library here
    tar -xvf nccl_2.2.13-1-cuda9.0_x86_64.tgz &&\
    rm -f nccl_2.2.13-1-cuda9.0_x86_64.tgz

ENV LD_LIBRARY_PATH /usr/nccl_2.2.13-1+cuda9.0_x86_64/lib/:${LD_LIBRARY_PATH}

# Change your way to get tensorflow_model_server here
WORKDIR /serving
RUN curl -sSL -o /usr/local/bin/tensorflow_model_server http://some-of-my-net-disk/tensorflow-serving/bin/tf-serving-${TF_VERSION}/tensorflow_model_server_gpu-centos &&\
    chmod u+x /usr/local/bin/tensorflow_model_server

For me, this worked fine. Hope it helps.