https://github.com/capsize-games/chatai
Official Repo for Chat AI
https://github.com/capsize-games/chatai
ai artificial-intelligence chatbot python python3
Last synced: 4 months ago
JSON representation
Official Repo for Chat AI
- Host: GitHub
- URL: https://github.com/capsize-games/chatai
- Owner: Capsize-Games
- License: gpl-3.0
- Created: 2023-03-23T19:22:48.000Z (over 3 years ago)
- Default Branch: master
- Last Pushed: 2023-05-13T20:26:22.000Z (about 3 years ago)
- Last Synced: 2025-04-09T16:05:58.406Z (about 1 year ago)
- Topics: ai, artificial-intelligence, chatbot, python, python3
- Language: Python
- Homepage: https://capsizegames.itch.io/chat-ai
- Size: 1.44 MB
- Stars: 32
- Watchers: 1
- Forks: 4
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
[](https://capsizegames.itch.io/chat-ai)
[](https://github.com/Capsize-Games/chatai/actions/workflows/repository-dispatch.yml)
[](https://github.com/Capsize-Games/chatai/actions/workflows/python-publish.yml)
[](https://discord.gg/PUVDDCJ7gz)
# Chat AI: Run LLMs with your own hardware
Chat AI is an interface that sits on top of a custom engine which is responsible for processing requests and responses
to and from an active Google T5-Flan model.
---
## Bundled Installation
[Official Build can be acquired here](https://capsizegames.itch.io/chat-ai) for those who want to use a compiled version of Chat AI without having to install any additional requirements
---
## Development
### Prerequisites
- Ubuntu 20.04+ or Windows 10+
- Python 3.10.6
- pip-23.0.1
---
### Docker
[Current builds of AI Runner are compiled with pyinstaller on docker.](https://github.com/Capsize-Games/airunner/pkgs/container/airunner%2Fairunner)
**Pull Docker container from repo**
Linux
```
docker pull ghcr.io/capsize-games/chatairunner/chatairunner:linux
```
Windows
```
docker pull ghcr.io/capsize-games/chatairunner/chatairunner:windows
```
**Build Docker**
Linux
```
docker-compose -f docker-compose.yml build
docker tag ghcr.io/capsize-games/chatairunner/chatairunner:linux ghcr.io/capsize-games/chatairunner/chatairunner:linux
docker push ghcr.io/capsize-games/chatairunner/chatairunner:linux
```
Windows
```
docker-compose -f docker-compose.windows.yml build
docker tag ghcr.io/capsize-games/chatairunner/chatairunner:linux ghcr.io/capsize-games/chatairunner/chatairunner:windows
docker push ghcr.io/capsize-games/chatairunner/chatairunner:windows
```
**Run the app using Docker**
```
docker-compose run linux python3 /app/main.py
```
**Build latest version** of AI Runner using Docker locally - this will output a `build` and `dist` folder on your machine.
```
docker run --rm -v $(pwd)/dist:/app/dist -v $(pwd)/build:/app/build ghcr.io/capsize-games/chatai/chatai:linux bash build.sh
docker run --rm -m 24g --cpus=12 -v $(pwd)/dist:/app/dist -v $(pwd)/build:/app/build ghcr.io/capsize-games/chatai/chatai:windows bash build.windows.sh
```
```
docker tag ghcr.io/capsize-games/chatai/chatai:linux ghcr.io/capsize-games/chatai/chatai:windows
docker push ghcr.io/capsize-games/chatai/chatai:windows
``
---
#### Pypi installation
Use this installation method if you intend to use Chat AI from the command line or with
other python libraries or scripts.
Windows
```
pip install torch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 --index-url https://download.pytorch.org/whl/cu117
pip install aihandlerwindows
pip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix_0.0.1.tar.gz
pip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz
pip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.0/bitsandbytes-0.37.2-py3-none-any.whl
pip install chatai --no-deps
```
Linux
```
pip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix_0.0.1.tar.gz
pip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz
pip install chatairunner
```
#### Development installation
Use this installation method if you intend to modify the source code of Chat AI.
- Ubuntu 20.04+ or Windows 10+
- Python 3.10.6
- pip-23.0.1
1. Fork this repo on github
2. `git clone https://github.com/Capsize-Games/chatai`
3. `python -m venv env` - skip if you don't want to use venv
3. `cd chatai && pip install -e .`
4. `cd chatai && python main.py`
---
Here are the special tokens used by the model:
- : Used to pad sequences to a fixed length.
- : Beginning of sequence token, used to indicate the start of a sequence.
- : End of sequence token, used to indicate the end of a sequence.
- : Unknown token, used to represent out-of-vocabulary words.
- : Mask token, used for masked language modeling tasks.
- : Special token used to represent additional task-specific labels, where X is a number from 0 to 99.
- : End of turn token, used in conversation models to indicate the end of a speaker's turn.