https://github.com/calcuis/callgg
GGUF caller
https://github.com/calcuis/callgg
callgg gguf llama
Last synced: 4 months ago
JSON representation
GGUF caller
- Host: GitHub
- URL: https://github.com/calcuis/callgg
- Owner: calcuis
- License: mit
- Created: 2024-02-09T05:05:33.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-02-28T23:28:27.000Z (over 1 year ago)
- Last Synced: 2025-02-13T14:40:56.052Z (4 months ago)
- Topics: callgg, gguf, llama
- Language: Python
- Homepage: https://pypi.org/project/callgg/
- Size: 37.1 KB
- Stars: 1
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
### GGUF model caller
[
](https://github.com/calcuis/callgg)
[](https://github.com/calcuis/callgg/releases)
This package is a GGUF (GPT-Generated Unified Format) file/model caller.
#### install the caller via pip/pip3 (once only):
```
pip install callgg
```
#### update the caller (if not in the latest version) by:
```
pip install callgg --upgrade
```
### user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
```
callgg -h
```
#### call gguf-selector for running a GGUF model/file:
```
callgg run
```
GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.
[
](https://github.com/calcuis/chatgpt-model-selector/blob/main/demo.gif)
[
](https://github.com/calcuis/chatgpt-model-selector/blob/main/demo1.gif)
#### save feature
```
callgg save [url]
```
You might need the ssl certificate to make this feature works; install it by: `pip install certifi` if you don't have;
or you can upgrade your llama-core by: `pip install llama-core --upgrade` then it will come with those packages (certificate, new loading bar module, etc.)
#### sample model(s) available to download (try out)
For general purpose
[chat.gguf] (file size: around 2GB or less)
```
callgg save https://huggingface.co/calcuis/chat/resolve/main/chat.gguf
```
For coding assistance
[code.gguf] (file size: around 3GB or more)
```
callgg save https://huggingface.co/calcuis/code_mini/resolve/main/code.gguf
```
For health/medical advice
[medi.gguf] (file size: around 3GB or more)
```
callgg save https://huggingface.co/calcuis/medi_mini/resolve/main/medi.gguf
```
For law/legal opinion
[law.gguf] (size: around 3GB or more)
```
callgg save chttps://huggingface.co/calcuis/law_mini/resolve/main/law.gguf
```
For wealth/financial plan
[finance.gguf] (size: around 3GB or more)
```
callgg save https://huggingface.co/calcuis/gguf/resolve/main/finance.gguf
```
***those are all experimental models; no guarantee on quality