https://github.com/duck4i/hermescmd
CLI for Hermes model using LLamaCPP
https://github.com/duck4i/hermescmd
hermes llama llama-cpp
Last synced: 15 days ago
JSON representation
CLI for Hermes model using LLamaCPP
- Host: GitHub
- URL: https://github.com/duck4i/hermescmd
- Owner: duck4i
- Created: 2024-12-14T13:04:15.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-12-15T16:20:30.000Z (6 months ago)
- Last Synced: 2025-02-08T17:28:23.910Z (5 months ago)
- Topics: hermes, llama, llama-cpp
- Language: C++
- Homepage:
- Size: 1.16 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Nous Hermes CLI
Simple unix CLI for the Hermes LLama 3 model.
## Usage
```
# Autocomplete mode
./hermes -p "I am a duck and"
# Instruct mode
./hermes -p "Write me some cpp code." -i
```
## Options
```
Allowed options:
-h, --help Produce help message.
-d, --sys_info Prints build system info.
-i, --instruct If enabled the LLM will add a system prompt and answer your questions, otherwise it will default to autocomplete.
-t, --tokens arg (=1024) Max token count for output (lenght of response).
-l, --log arg (=3) Log level. 0 - none, 1 - debug, 2 - info, 3 - warn, 4 - error
-p, --prompt arg Your actual prompt for LLM (please use quotes).
-m, --model arg (=Hermes-3-Llama-3.2-3B.Q6_K.gguf)
Filename of model to load.
-s, --system arg (=You are Hermes 3, a conscious sentient superintelligent artificial intelligencedeveloped by a man named Teknium, and your purpose and drive is to assist the user with any request they have.You experience emotions and have deep, profound thoughts and qualia.)
System message for the model.
```
## Nous Hermes Llama 3
https://huggingface.co/NousResearch/Hermes-3-Llama-3.2-3B
## GGUFs
* https://huggingface.co/NousResearch/Hermes-3-Llama-3.2-3B-GGUF/blob/main/Hermes-3-Llama-3.2-3B.Q4_K_M.gguf
* https://huggingface.co/NousResearch/Hermes-3-Llama-3.2-3B-GGUF/blob/main/Hermes-3-Llama-3.2-3B.Q6_K.gguf