https://github.com/rpidanny/tensorflow-serving-hot-reload
A script to dynamically load / unload tensorflow models in serving
https://github.com/rpidanny/tensorflow-serving-hot-reload
machine-learning python tensorflow tensorflow-model-server tensorflow-serving tensorflow-serving-api
Last synced: 4 months ago
JSON representation
A script to dynamically load / unload tensorflow models in serving
- Host: GitHub
- URL: https://github.com/rpidanny/tensorflow-serving-hot-reload
- Owner: rpidanny
- License: mit
- Created: 2019-01-15T08:38:11.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2019-01-15T09:18:20.000Z (about 7 years ago)
- Last Synced: 2025-06-02T12:30:46.551Z (8 months ago)
- Topics: machine-learning, python, tensorflow, tensorflow-model-server, tensorflow-serving, tensorflow-serving-api
- Language: Python
- Size: 13.7 KB
- Stars: 1
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# tensorflow-serving-hot-reload
A script to dynamically load / unload tensorflow models in serving using config file.
## Requirements
- `tensorflow===1.12.0`
- `tensorflow-serving-api===1.12.0`
## Usage
`python reload.py -c /home/user/models.config -H 192.168.2.2:8500`
### Example serving config file
```
model_config_list: {
config: {
name:"FLOWER_5flowers",
base_path: "/serving/models/FLOWER/serving/FLOWER_5flowers",
model_platform: "tensorflow"
},
config: {
name:"FLOWER_alpha",
base_path: "/serving/models/FLOWER/serving/FLOWER_alpha",
model_platform: "tensorflow"
},
config: {
name:"FLOWER_test",
base_path: "/serving/models/FLOWER/serving/FLOWER_test",
model_platform: "tensorflow"
}
}
```