Projects in Awesome Lists tagged with lmdeploy
A curated list of projects in awesome lists tagged with lmdeploy .
https://github.com/shell-nlp/gpt_server
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
asr embedding fastchat function-calling gpt infinity llama llm lmdeploy openai prompt-injection rerank sglang text-moderation tts vllm
Last synced: 28 Feb 2026
https://github.com/wtlow003/modal-llm-serving
Examples of serving LLM on Modal.
llm lmdeploy modal model-serving openai openai-api sglang vllm
Last synced: 27 Apr 2026
