https://github.com/shell-nlp/gpt_server
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
https://github.com/shell-nlp/gpt_server
asr embedding fastchat function-calling gpt infinity llama llm lmdeploy openai prompt-injection rerank sglang text-moderation tts vllm
Last synced: 9 days ago
JSON representation
gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
- Host: GitHub
- URL: https://github.com/shell-nlp/gpt_server
- Owner: shell-nlp
- License: apache-2.0
- Created: 2023-12-16T07:43:28.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2026-02-25T09:43:30.000Z (13 days ago)
- Last Synced: 2026-02-25T10:42:34.247Z (12 days ago)
- Topics: asr, embedding, fastchat, function-calling, gpt, infinity, llama, llm, lmdeploy, openai, prompt-injection, rerank, sglang, text-moderation, tts, vllm
- Language: Python
- Homepage: https://blog.csdn.net/q506610466/article/details/151360406
- Size: 5.73 MB
- Stars: 244
- Watchers: 3
- Forks: 21
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE