https://github.com/255doesnotexist/vllm_openai_api_server

vLLM Misc codes to serve an openai-like api server
https://github.com/255doesnotexist/vllm_openai_api_server

Last synced: 10 months ago
JSON representation

vLLM Misc codes to serve an openai-like api server

• Host: GitHub
• URL: https://github.com/255doesnotexist/vllm_openai_api_server
• Owner: 255doesnotexist
• License: mit
• Created: 2024-03-15T19:03:56.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-03-16T06:56:35.000Z (almost 2 years ago)
• Last Synced: 2025-01-11T19:50:54.462Z (12 months ago)
• Language: Python
• Size: 5.86 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Serve legacy OpenAI-like API with vLLM 

A simple project try to serve openai legacy api with high performance LLM framework vLLM.