{"id":23331070,"url":"https://github.com/capsize-games/chatai","last_synced_at":"2026-03-08T07:33:08.036Z","repository":{"id":147938586,"uuid":"618111514","full_name":"Capsize-Games/chatai","owner":"Capsize-Games","description":"Official Repo for Chat AI","archived":false,"fork":false,"pushed_at":"2023-05-13T20:26:22.000Z","size":1507,"stargazers_count":32,"open_issues_count":1,"forks_count":4,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-09T16:05:58.406Z","etag":null,"topics":["ai","artificial-intelligence","chatbot","python","python3"],"latest_commit_sha":null,"homepage":"https://capsizegames.itch.io/chat-ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Capsize-Games.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-23T19:22:48.000Z","updated_at":"2024-10-16T04:47:26.000Z","dependencies_parsed_at":"2023-05-28T01:30:15.216Z","dependency_job_id":null,"html_url":"https://github.com/Capsize-Games/chatai","commit_stats":null,"previous_names":[],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/Capsize-Games/chatai","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Capsize-Games%2Fchatai","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Capsize-Games%2Fchatai/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Capsize-Games%2Fchatai/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Capsize-Games%2Fchatai/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Capsize-Games","download_url":"https://codeload.github.com/Capsize-Games/chatai/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Capsize-Games%2Fchatai/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30248946,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-08T05:41:50.788Z","status":"ssl_error","status_checked_at":"2026-03-08T05:41:39.075Z","response_time":56,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","artificial-intelligence","chatbot","python","python3"],"created_at":"2024-12-20T22:30:29.255Z","updated_at":"2026-03-08T07:33:08.011Z","avatar_url":"https://github.com/Capsize-Games.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Banner](banner.png)](https://capsizegames.itch.io/chat-ai)\n[![Linux Build](https://github.com/Capsize-Games/chatai/actions/workflows/repository-dispatch.yml/badge.svg)](https://github.com/Capsize-Games/chatai/actions/workflows/repository-dispatch.yml)\n[![Upload Python Package](https://github.com/Capsize-Games/chatai/actions/workflows/python-publish.yml/badge.svg)](https://github.com/Capsize-Games/chatai/actions/workflows/python-publish.yml)\n[![Discord](https://img.shields.io/discord/839511291466219541?color=5865F2\u0026logo=discord\u0026logoColor=white)](https://discord.gg/PUVDDCJ7gz)\n![GitHub](https://img.shields.io/github/license/Capsize-Games/chatai)\n![GitHub last commit](https://img.shields.io/github/last-commit/Capsize-Games/chatai)\n![GitHub issues](https://img.shields.io/github/issues/Capsize-Games/chatai)\n![GitHub closed issues](https://img.shields.io/github/issues-closed/Capsize-Games/chatai)\n![GitHub pull requests](https://img.shields.io/github/issues-pr/Capsize-Games/chatai)\n![GitHub closed pull requests](https://img.shields.io/github/issues-pr-closed/Capsize-Games/chatai)\n\n# Chat AI: Run LLMs with your own hardware\n\nChat AI is an interface that sits on top of a custom engine which is responsible for processing requests and responses \nto and from an active Google T5-Flan model.\n\n![img.png](img.png)\n\n---\n\n## Bundled Installation\n\n[Official Build can be acquired here](https://capsizegames.itch.io/chat-ai) for those who want to use a compiled version of Chat AI without having to install any additional requirements\n\n---\n\n## Development\n\n### Prerequisites\n\n- Ubuntu 20.04+ or Windows 10+\n- Python 3.10.6\n- pip-23.0.1\n\n---\n\n### Docker\n\n[Current builds of AI Runner are compiled with pyinstaller on docker.](https://github.com/Capsize-Games/airunner/pkgs/container/airunner%2Fairunner)\n\n**Pull Docker container from repo**\n\nLinux\n```\ndocker pull ghcr.io/capsize-games/chatairunner/chatairunner:linux\n```\n\nWindows\n```\ndocker pull ghcr.io/capsize-games/chatairunner/chatairunner:windows\n```\n\n**Build Docker**\n\nLinux\n```\ndocker-compose -f docker-compose.yml build\ndocker tag ghcr.io/capsize-games/chatairunner/chatairunner:linux ghcr.io/capsize-games/chatairunner/chatairunner:linux\ndocker push ghcr.io/capsize-games/chatairunner/chatairunner:linux\n```\n\nWindows\n```\ndocker-compose -f docker-compose.windows.yml build\ndocker tag ghcr.io/capsize-games/chatairunner/chatairunner:linux ghcr.io/capsize-games/chatairunner/chatairunner:windows\ndocker push ghcr.io/capsize-games/chatairunner/chatairunner:windows\n```\n\n**Run the app using Docker**\n```\ndocker-compose run linux python3 /app/main.py\n```\n\n**Build latest version** of AI Runner using Docker locally - this will output a `build` and `dist` folder on your machine.\n```\ndocker run --rm -v $(pwd)/dist:/app/dist -v $(pwd)/build:/app/build ghcr.io/capsize-games/chatai/chatai:linux bash build.sh\n\ndocker run --rm -m 24g --cpus=12 -v $(pwd)/dist:/app/dist -v $(pwd)/build:/app/build ghcr.io/capsize-games/chatai/chatai:windows bash build.windows.sh\n```\n\n```\ndocker tag ghcr.io/capsize-games/chatai/chatai:linux ghcr.io/capsize-games/chatai/chatai:windows\ndocker push ghcr.io/capsize-games/chatai/chatai:windows\n``\n\n---\n\n#### Pypi installation\n\nUse this installation method if you intend to use Chat AI from the command line or with\nother python libraries or scripts.\n\nWindows\n```\npip install torch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 --index-url https://download.pytorch.org/whl/cu117\npip install aihandlerwindows\npip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix_0.0.1.tar.gz\npip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz\npip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.0/bitsandbytes-0.37.2-py3-none-any.whl\npip install chatai --no-deps\n```\n\nLinux\n```\npip install https://github.com/w4ffl35/diffusers/archive/refs/tags/v0.14.0.ckpt_fix_0.0.1.tar.gz\npip install https://github.com/w4ffl35/transformers/archive/refs/tags/tensor_fix-v1.0.2.tar.gz\npip install chatairunner\n```\n\n#### Development installation\n\nUse this installation method if you intend to modify the source code of Chat AI.\n\n- Ubuntu 20.04+ or Windows 10+\n- Python 3.10.6\n- pip-23.0.1\n\n1. Fork this repo on github\n2. `git clone https://github.com/Capsize-Games/chatai`\n3. `python -m venv env` - skip if you don't want to use venv\n3. `cd chatai \u0026\u0026 pip install -e .`\n4. `cd chatai \u0026\u0026 python main.py`\n\n---\n\nHere are the special tokens used by the model:\n\n- \u003cpad\u003e: Used to pad sequences to a fixed length.\n- \u003cbos\u003e: Beginning of sequence token, used to indicate the start of a sequence.\n- \u003ceos\u003e: End of sequence token, used to indicate the end of a sequence.\n- \u003cunk\u003e: Unknown token, used to represent out-of-vocabulary words.\n- \u003cmask\u003e: Mask token, used for masked language modeling tasks.\n- \u003cextra_id_X\u003e: Special token used to represent additional task-specific labels, where X is a number from 0 to 99.\n- \u003ceot\u003e: End of turn token, used in conversation models to indicate the end of a speaker's turn.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcapsize-games%2Fchatai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcapsize-games%2Fchatai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcapsize-games%2Fchatai/lists"}