gotf

Go Tensorflow (GOTF)

Serving the Tensorflow Resnet Model using Docker and:

• Basic Python
• Compiled Go
• Tensorflow Serving

Performance tested using Vegeta

Serving

Change into the example you'd like to run.

This is a resnet model.

Build and run docker images for Basic and Compiled Go servers

$ docker build -f docker/base.Dockerfile . -t base ; docker run -p 8501:8080 -it base:latest

$ docker build -f docker/compiled.Dockerfile . -t compiled ; docker run -p 8501:8080 -it compiled:latest

Tensorflow serving

docker run -p 8501:8501 \
  --mount type=bind,source=/Users/alicecheung/Downloads/gotf/model,target=/models/resnet_model \
  -e MODEL_NAME=resnet_model -t tensorflow/serving

Performance Testing

Run test in testing directory

$ go run test.go

Links:

• Blog post about with step by step for this repo: https://syslog.ravelin.com/go-tensorflow-74d1101fab3f
• Presentation: https://prezi.com/p/edit/qbhcjhy_bepi/