https://github.com/255doesnotexist/vllm_openai_api_server
vLLM Misc codes to serve an openai-like api server
https://github.com/255doesnotexist/vllm_openai_api_server
Last synced: 10 months ago
JSON representation
vLLM Misc codes to serve an openai-like api server
- Host: GitHub
- URL: https://github.com/255doesnotexist/vllm_openai_api_server
- Owner: 255doesnotexist
- License: mit
- Created: 2024-03-15T19:03:56.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-03-16T06:56:35.000Z (almost 2 years ago)
- Last Synced: 2025-01-11T19:50:54.462Z (12 months ago)
- Language: Python
- Size: 5.86 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Serve legacy OpenAI-like API with vLLM
A simple project try to serve openai legacy api with high performance LLM framework vLLM.