https://github.com/null-dev/llmcode-server
LLM server that provides an optimized version of the WizardCoder model as an API endpoint
https://github.com/null-dev/llmcode-server
Last synced: 4 months ago
JSON representation
LLM server that provides an optimized version of the WizardCoder model as an API endpoint
- Host: GitHub
- URL: https://github.com/null-dev/llmcode-server
- Owner: null-dev
- Created: 2023-08-09T08:55:04.000Z (almost 3 years ago)
- Default Branch: master
- Last Pushed: 2023-08-09T09:02:10.000Z (almost 3 years ago)
- Last Synced: 2024-08-05T15:07:38.199Z (almost 2 years ago)
- Language: Rust
- Size: 10.7 KB
- Stars: 5
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# llmcode-server
llmcode-server provides an API endpoint for using the WizardCoder-15B model.
Features:
- Optimized for fast responses
- Uses [CTranslate2](https://github.com/OpenNMT/CTranslate2) and https://huggingface.co/michaelfeil/ct2fast-WizardCoder-15B-V1.0
- Designed for: https://github.com/videogameaholic/starcoder-intellij