https://github.com/calcuis/llama-cpp-python-gradio-server
https://github.com/calcuis/llama-cpp-python-gradio-server
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/calcuis/llama-cpp-python-gradio-server
- Owner: calcuis
- Created: 2024-01-17T01:01:04.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-17T01:14:44.000Z (almost 2 years ago)
- Last Synced: 2025-03-14T20:34:30.595Z (10 months ago)
- Language: Python
- Size: 4.88 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## llama-cpp-python-gradio-ui-server/localhost
**significantly faster than cTransformers with the pre-loaded model approach
*comment out "share=True": localhost only
run it by (pull the pre-trained model file chat.gguf in the same directory):
```
python chat.py
```