{"id":45215887,"url":"https://github.com/krzyzyk33/cmdai","last_synced_at":"2026-03-02T21:20:42.570Z","repository":{"id":339408937,"uuid":"1161807233","full_name":"Krzyzyk33/CMDAI","owner":"Krzyzyk33","description":"Local two-file AI app for running GGUF models via llama-cpp-python: model loading, terminal chat, and much more....","archived":false,"fork":false,"pushed_at":"2026-02-20T15:11:40.000Z","size":2343,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-02-20T15:35:42.801Z","etag":null,"topics":["ai","awesome-gguf","awesome-llm","awesome-local-ai","awesome-python","awsome-ai","chatbot","cli","cmd","cmd-ai","cmdai","developer-tools","local","local-ai","localhost","offline-ai","offline-models","ofline","terminal","terminal-ai"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Krzyzyk33.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":"ROADMAP.md","authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-02-19T14:41:21.000Z","updated_at":"2026-02-20T15:04:38.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/Krzyzyk33/CMDAI","commit_stats":null,"previous_names":["krzyzyk33/cmd-ai-loader","krzyzyk33/cmdai"],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/Krzyzyk33/CMDAI","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Krzyzyk33%2FCMDAI","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Krzyzyk33%2FCMDAI/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Krzyzyk33%2FCMDAI/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Krzyzyk33%2FCMDAI/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Krzyzyk33","download_url":"https://codeload.github.com/Krzyzyk33/CMDAI/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Krzyzyk33%2FCMDAI/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29658167,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-20T16:33:43.953Z","status":"ssl_error","status_checked_at":"2026-02-20T16:33:43.598Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","awesome-gguf","awesome-llm","awesome-local-ai","awesome-python","awsome-ai","chatbot","cli","cmd","cmd-ai","cmdai","developer-tools","local","local-ai","localhost","offline-ai","offline-models","ofline","terminal","terminal-ai"],"created_at":"2026-02-20T17:02:53.618Z","updated_at":"2026-02-20T17:02:54.359Z","avatar_url":"https://github.com/Krzyzyk33.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"![CMDAI](assets/CMDAI.ico)\r\n---\r\n\r\nA local terminal AI assistant based on GGUF and llama‑cpp‑python models.\r\nNo cloud. Zero telemetry. Complete privacy.\r\n\r\n## 🎥 Demo\r\ncoming soon\r\n\r\n## ⚙️ Functions\r\n\r\nThe application runs completely offline, using only local GGUF models, ensuring complete privacy and no internet dependency. It allows for conversations in the terminal. It supports downloading models from the `models` file, automatic model loading, generating responses, and much more. It has a built-in lightweight HTTP server that provides an API for communicating with the model in other applications.\r\n\r\n## 🔧 Instructions\r\n\r\n### Quick Start\r\n\r\n1. Python 3.11+ required.\r\n2. Install a GGUF model and copy it to models/.\r\n3. Run the application:\r\n`py -3 run.py`\r\n4. Load the model:\r\n`load \u003cfilename.gguf\u003e`\r\n5. Talk to the model:\r\n`ai`\r\nor:\r\n`chat \u003ctext\u003e`\r\n\r\n### CLI commands\r\n\r\n- `load` - choose model from list\r\n- `load \u003cname\u003e` - load model by filename\r\n- `models` - list local GGUF models\r\n- `catalog` - list downloadable aliases\r\n- `download \u003calias|url\u003e [file.gguf]` - download model\r\n- `pull \u003calias|url\u003e [file.gguf]` - alias for `download`\r\n- `ai` - chat mode (`AI\u003e`)\r\n- `chat \u003ctext\u003e` - single message\r\n- `unload` - unload model from RAM\r\n- `status` - app status\r\n- `version` - `llama-cpp-python` version\r\n- `update` - runtime update\r\n\r\n### SERVER (localhost:8080)\r\n\r\n- `GET /tags`\r\n- `POST /generate`\r\n- `POST /chat`\r\n- `POST /pull`\r\n- `GET /version`\r\n\r\n\r\n---\r\n\r\n## How to Help with CMDAI\r\n\r\nThank you for your interest in improving CMDAI!\r\nHere are simple ways you can support the project.\r\n\r\n### Ways You Can Help\r\n\r\n- Report bugs in the **Issues** tab\r\n- Suggest new features\r\n- Test the application on your system\r\n- Share improvement ideas\r\n- Add and test new GGUF models\r\n\r\n### How to Submit an Issue\r\n\r\n1. Go to the **Issues** tab\r\n2. Click **New Issue**\r\n3. Choose: Bug / Feature / Idea\r\n4. Describe the problem or suggestion clearly\r\n\r\nEvery contribution is appreciated!\r\n\r\n---\r\n\r\n## Notes:\r\n\r\n- `models/` and large local binaries are excluded from the repository by `.gitignore`.\r\n- This project is designed to run fully local models.\r\n- The application can only work with the `models/` file and the `run.py` file\r\n\r\n---\r\n\r\n## ⭐ Inspirations\r\n\r\nThis project was inspired by tools like **Ollama** and **LM Studio**, which showed how powerful and accessible local AI models can be.  \r\nI wanted to bring a similar experience directly into the command line — simple, fast, and fully local — without the need for heavy interfaces or external services.  \r\nCMD LOCAL AI is my attempt to create a clean, terminal‑native way to interact with AI models.\r\n\r\n---\r\n\r\n## 🚀 Future Ideas\r\n\r\nCMD LOCAL AI is a project being developed step by step. Below are the directions I plan to develop in future versions:\r\n\r\n- **Support for multiple models simultaneously** - switching between local models without restarting the application.\r\n- **Performance profiling** - real-time viewing of generation time and RAM and CPU usage.\r\n- **Developer Tools mode** - viewing system prompts, tokens, and raw model responses.\r\n- **Integration with plugins/extensions** - the ability to add custom commands and actions performed by the AI.\r\n- **Support for audio and vision models** - speech and image support for compatible local models.\r\n  \r\n---\r\n\r\n### 🤗 THANKS FOR READING :)\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkrzyzyk33%2Fcmdai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkrzyzyk33%2Fcmdai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkrzyzyk33%2Fcmdai/lists"}