https://github.com/paulhendricks/inference-server
https://github.com/paulhendricks/inference-server
Last synced: 9 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/paulhendricks/inference-server
- Owner: paulhendricks
- Created: 2018-05-18T20:27:06.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2018-05-18T20:54:13.000Z (over 7 years ago)
- Last Synced: 2025-02-13T10:16:38.301Z (11 months ago)
- Language: Python
- Size: 2.93 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Inference Server
Build the gRPC image from the Dockerfile:
```bash
docker build -t inference_server .
```
Run the server:
```bash
docker run -it --rm -d -u $(id -u):$(id -g) -v $PWD:$PWD -w $PWD inference_server python inference_server/inference_server.py
```
Use the `` that was printed to the screen and run the client:
```bash
docker exec python inference_server/inference_client.py 42
```
Use the following to re-compile the Python protobuff code if necessary:
```bash
docker run -d -u $(id -u):$(id -g) -v $PWD:$PWD -w $PWD inference_server \
python -m grpc_tools.protoc -I . \
--python_out=inference_server --grpc_python_out=inference_server inference_server.proto
```