https://github.com/runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
https://github.com/runpod-workers/worker-vllm
language-model llm runpod vllm
Last synced: 4 months ago
JSON representation
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
- Host: GitHub
- URL: https://github.com/runpod-workers/worker-vllm
- Owner: runpod-workers
- License: mit
- Created: 2023-07-03T18:42:36.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-31T19:07:02.000Z (4 months ago)
- Last Synced: 2024-10-31T20:18:40.723Z (4 months ago)
- Topics: language-model, llm, runpod, vllm
- Language: Python
- Homepage:
- Size: 26.3 MB
- Stars: 239
- Watchers: 7
- Forks: 96
- Open Issues: 24
-
Metadata Files:
- Readme: README.md
- License: LICENSE