Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/rishit-dagli/tfserving-demos

TF Serving demos
https://github.com/rishit-dagli/tfserving-demos

jupyter-notebook model-serving python3 tensorflow tensorflow-model-server tensorflow-serving tensorflow2

Last synced: 21 days ago
JSON representation

TF Serving demos

Awesome Lists containing this project

README

        

# TfServing-Demos

[![Open in Colab button](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Rishit-dagli/TFServing-Demos)
[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/Rishit-dagli/TFServing-Demos/master)

[![](https://img.shields.io/badge/Rishit-Dagli-brightgreen.svg?colorB=00ff00)](https://www.rishit.tech)
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
![GitHub followers](https://img.shields.io/github/followers/Rishit-dagli?style=social)
![Twitter Follow](https://img.shields.io/twitter/follow/rishit_dagli?style=social)
![Twitter URL](https://img.shields.io/twitter/url?style=social&url=https%3A%2F%2Fgithub.com%2FRishit-dagli%2FGDG-Ahmedabad-2020)

Demos for my session about Deploying models to production with TensorFlow Serving. I would urge you to check out
[talks.md](https://github.com/Rishit-dagli/GDG-Ahmedabad-2020/blob/master/talks.md) for more details and the talks I have given about this. I would also urge you to check out the
[blog](https://towardsdatascience.com/deploying-models-to-production-with-tensorflow-model-server-225a81859031) by me on the same.

## Port Forwarding while on Colab

In case you want to test your API out while staying on Colab itself, you could easily forward your REST API port with ngrok to try out the API outside of Colab using this code:

```py
!pip install pyngrok

from pyngrok import ngrok
model_tunnel = ngrok.connect(8501)
print(model_tunnel)
```