https://github.com/runpod-workers/worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
https://github.com/runpod-workers/worker-vllm

language-model llm runpod vllm

Last synced: 11 days ago
JSON representation

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

• Host: GitHub
• URL: https://github.com/runpod-workers/worker-vllm
• Owner: runpod-workers
• License: mit
• Created: 2023-07-03T18:42:36.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-31T19:07:02.000Z (16 days ago)
• Last Synced: 2024-10-31T20:18:40.723Z (16 days ago)
• Topics: language-model, llm, runpod, vllm
• Language: Python
• Homepage:
• Size: 26.3 MB
• Stars: 239
• Watchers: 7
• Forks: 96
• Open Issues: 24
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project