Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/runpod-workers/worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
https://github.com/runpod-workers/worker-vllm

language-model llm runpod vllm

Last synced: 11 days ago
JSON representation

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

Awesome Lists containing this project