https://github.com/magicteamc/autogguf
Let me make GGUF files quickly
https://github.com/magicteamc/autogguf
gguf llama-cpp llamacpp llm llm-quantization
Last synced: 20 days ago
JSON representation
Let me make GGUF files quickly
- Host: GitHub
- URL: https://github.com/magicteamc/autogguf
- Owner: MagicTeaMC
- License: gpl-3.0
- Created: 2025-05-24T04:23:20.000Z (12 months ago)
- Default Branch: main
- Last Pushed: 2025-06-04T02:32:54.000Z (12 months ago)
- Last Synced: 2025-06-30T03:39:29.406Z (11 months ago)
- Topics: gguf, llama-cpp, llamacpp, llm, llm-quantization
- Language: Python
- Homepage:
- Size: 19.5 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Setup
1.
```
git clone https://github.com/ggml-org/llama.cpp.git
mv ./llama.cpp ./llama
```
2. Download latest llama.cpp bin:
3. move it into llama folder (it will like this: `./llama/bin/`
4. clone model's HF repo in AutoGGUF folder.
5. Run `main.py`