https://github.com/Curt-Park/echo-grpc-triton
Inference API server with echo and gRPC to triton server (golang)
https://github.com/Curt-Park/echo-grpc-triton
Last synced: 6 months ago
JSON representation
Inference API server with echo and gRPC to triton server (golang)
- Host: GitHub
- URL: https://github.com/Curt-Park/echo-grpc-triton
- Owner: Curt-Park
- License: mit
- Created: 2022-11-13T03:02:00.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2022-11-16T08:22:52.000Z (almost 3 years ago)
- Last Synced: 2025-04-13T20:16:17.054Z (6 months ago)
- Language: Go
- Size: 271 KB
- Stars: 13
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# echo-grpc-triton
A simple API server for Triton inference server powered by echo and gRPC.
## Prerequisites
- Install [docker](https://docs.docker.com/engine/install/).
- Install [go](https://go.dev/doc/install) (Optional: If you want to run this project without Docker).
## Commands
```bash
docker-compose up # Run all services (API + Triton)
docker-compose kill # Kill all services
```
Open http://localhost:8080/docs/index.html to see the API documents and to send a single request.
Press `Try it out` button to call any API.
## References
- https://github.com/triton-inference-server/client/tree/main/src/grpc_generated/go
- https://github.com/sunhailin-Leo/triton-service-go
- https://echo.labstack.com/guide/
- https://github.com/swaggo/swag#api-operation