https://github.com/tangledgroup/llama-cpp-python-exploit
llama-cpp-python-exploit
https://github.com/tangledgroup/llama-cpp-python-exploit
Last synced: about 1 year ago
JSON representation
llama-cpp-python-exploit
- Host: GitHub
- URL: https://github.com/tangledgroup/llama-cpp-python-exploit
- Owner: tangledgroup
- License: mit
- Created: 2023-10-14T18:52:30.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-10-14T19:16:37.000Z (over 2 years ago)
- Last Synced: 2025-03-31T03:41:33.786Z (about 1 year ago)
- Language: Python
- Size: 3.91 KB
- Stars: 15
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# llama-cpp-python-exploit
Download in local directory Mistral-based models for `llama.cpp`:
1) Mistral-7B-v0.1-GGUF
https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/blob/main/mistral-7b-v0.1.Q5_K_M.gguf
```
python3.11 -m venv venv
source venv/bin/activate
pip install -r requirements.txt --force-reinstall --upgrade --no-cache-dir
```
## References
* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python)
* [llama-cpp-python documentation](https://llama-cpp-python.readthedocs.io)
* [llama.cpp](https://github.com/ggerganov/llama.cpp)
* [Tangled Group, Inc](https://tangledgroup.com)
* https://github.com/abetlen/llama-cpp-python/blob/f30aa2012613df1e90e29f78e181a92366494ca6/llama_cpp/llama.py#L904
* https://github.com/abetlen/llama-cpp-python/blob/f30aa2012613df1e90e29f78e181a92366494ca6/llama_cpp/llama.py#L1295