https://github.com/rodjjo/bottled-ai
A chat bot using various LLM models. It runs locally using your own GPU and/or CPU.
https://github.com/rodjjo/bottled-ai
ai chatbot cpp llm python3
Last synced: 11 months ago
JSON representation
A chat bot using various LLM models. It runs locally using your own GPU and/or CPU.
- Host: GitHub
- URL: https://github.com/rodjjo/bottled-ai
- Owner: rodjjo
- License: unlicense
- Created: 2023-08-15T16:40:15.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-08-22T02:07:13.000Z (over 2 years ago)
- Last Synced: 2023-08-22T03:39:18.781Z (over 2 years ago)
- Topics: ai, chatbot, cpp, llm, python3
- Language: C++
- Homepage:
- Size: 609 KB
- Stars: 4
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# bottled-ai
Storyteller
## Description
This is a chatbot that runs locally using your GPU (GPTQ models) or CPU (GGML models).
It supports several models, and more models are going to be added soon.
*Main window*
*Model downloader*
## Installation
Platforms:
* Windows - There is an installer here: [Latest Release (windows)](https://github.com/rodjjo/bottled-ai/releases/download/v0.2.0/Bottled-AI-Setup.exe)
* Linux - Work In Progress
* Mac - Future (Maybe)
**Note**: Do not install inside `Program files` or other directory that requires admin access to write. The program download models inside its directory.
[Other Release](https://github.com/rodjjo/bottled-ai/releases)
## Build and run
Before start make sure you have 7zip, cmake, python 3.10 and Conan 1.59.0 installed.
The build.py script will download the toolset and all the dependencies.
Building the project
```bash
python devtools/build.py
```
Clear the build files and build it again
```bash
python devtools/rebuild.py
```
Run the project
```bash
# run:
python devtools/run.py --copy-stuff
# build and run:
python devtools/run.py --build --copy-stuff
```
## Credits
**FLTK**
* [User-Interface](https://www.fltk.org/doc-1.3/)