https://github.com/dstack-tee/vllm-proxy
https://github.com/dstack-tee/vllm-proxy
Last synced: 7 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/dstack-tee/vllm-proxy
- Owner: Dstack-TEE
- Created: 2025-12-04T02:12:31.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2026-06-10T21:10:49.000Z (7 days ago)
- Last Synced: 2026-06-10T22:05:09.365Z (7 days ago)
- Language: Python
- Size: 555 KB
- Stars: 0
- Watchers: 0
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# VLLM Proxy
A proxy for vLLM.
## Requirements
- Python 3.12+
## Run for development
```bash
# Run production server
uvicorn main:app --host 0.0.0.0 --reload
# Run development server
fastapi dev main.py --host 0.0.0.0
```
## Production
### Build for production
```bash
bash docker/build.sh
```
### Run for production
```bash
cd docker
docker compose up -d
```
## Tests
### Quick Start
```bash
python3 -m venv .venv
. .venv/bin/activate
pip install -r requirements.txt
pip install -r test-requirements.txt
./run_tests.sh
```
For detailed testing documentation, see [TESTING.md](./docs/TESTING.md).