https://github.com/calcuis/gguf-core
a simple way to interact llama with gguf
https://github.com/calcuis/gguf-core
cli core gguf gui llama metadata pdf reader wav
Last synced: 5 months ago
JSON representation
a simple way to interact llama with gguf
- Host: GitHub
- URL: https://github.com/calcuis/gguf-core
- Owner: calcuis
- License: mit
- Created: 2024-02-08T18:17:08.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-29T01:29:41.000Z (8 months ago)
- Last Synced: 2024-10-30T01:51:41.192Z (8 months ago)
- Topics: cli, core, gguf, gui, llama, metadata, pdf, reader, wav
- Language: Python
- Homepage: https://pypi.org/project/gguf-core
- Size: 106 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
### GGUF core
[
](https://github.com/calcuis/gguf-core)
[](https://github.com/calcuis/gguf-core/releases)
This package is a GGUF (GPT-Generated Unified Format) file caller.
#### install the caller via pip/pip3 (once only):
```
pip install gguf-core
```
#### update the caller (if not in the latest version) by:
```
pip install gguf-core --upgrade
```
### user manual
This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.
```
gguf -h
```
#### check current version
```
gguf -v
```
#### cli connector
with command-line interface
```
gguf c
```
#### gui connector
with graphical user interface
```
gguf g
```
#### vision connector (beta)
with vision model supported
```
gguf v
```
#### interface selector
selection menu for connector interface(s) above
```
gguf i
```
#### metadata reader
read model metadata for detail(s)
```
gguf r
```
or try model analyzor (beta)
```
gguf a
```
GGUF file(s) in the current directory will automatically be detected by the caller.
#### get feature
get GGUF from URL; clone/download it to the current directory
```
gguf get [url]
```
#### sample model list
You can either use the get feature above or opt a sample GGUF straight from the sample list by:
```
gguf s
```
#### prompt generator (beta)
Generate bulk prompt/descriptor(s) by:
```
gguf prompt
```
#### gguf node (beta)
Download ComfyUI GGUF portable package with gguf node by:
```
gguf node
```
#### pdf analyzor (beta)
You can now load your PDF file(s) straight into the model for generating digested summary; try it out by:
```
gguf p
```
#### wav analyzor (offline)
You can speak/talk straight to GGUF right away; prompt WAV(s) into the model for feedback; try it out by:
```
gguf f
```
#### wav analyzor (online)
more accurate (via google Open api); Internet access needed; try it out by:
```
gguf o
```
#### launch to page/container (gguf.org)
```
gguf org
```
#### launch to page/container (gguf.io)
```
gguf io
```
#### launch to page/container (gguf.us)
```
gguf us
```