{"id":14964780,"url":"https://github.com/skywardai/kirin","last_synced_at":"2025-10-25T10:30:44.043Z","repository":{"id":228924914,"uuid":"769958891","full_name":"SkywardAI/kirin","owner":"SkywardAI","description":"Self-hosted and local-first application for inference and RAG on consumer grade hardware.","archived":false,"fork":false,"pushed_at":"2024-10-28T08:58:33.000Z","size":937,"stargazers_count":8,"open_issues_count":22,"forks_count":8,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-10-30T00:52:23.882Z","etag":null,"topics":["ai","api","container","conversational-ai","deep-learning","fine-tuning","llm-inference","localai","rag","sentence-embeddings","vector-database"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/SkywardAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-10T14:42:02.000Z","updated_at":"2024-10-07T04:51:48.000Z","dependencies_parsed_at":"2024-03-29T10:45:51.104Z","dependency_job_id":"4cdb23ce-c2c8-4c9a-82b0-b6320c2241b9","html_url":"https://github.com/SkywardAI/kirin","commit_stats":null,"previous_names":["skywardai/chat-backend","skywardai/kirin"],"tags_count":13,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkywardAI%2Fkirin","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkywardAI%2Fkirin/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkywardAI%2Fkirin/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkywardAI%2Fkirin/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/SkywardAI","download_url":"https://codeload.github.com/SkywardAI/kirin/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":238120376,"owners_count":19419761,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","api","container","conversational-ai","deep-learning","fine-tuning","llm-inference","localai","rag","sentence-embeddings","vector-database"],"created_at":"2024-09-24T13:33:46.170Z","updated_at":"2025-10-25T10:30:38.696Z","avatar_url":"https://github.com/SkywardAI.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=center\u003e\u003cstrong\u003eKirin\u003c/strong\u003e\u003c/h1\u003e\n\n[![Linter and Builder 🚀](https://github.com/SkywardAI/chat-backend/actions/workflows/linter-and-builder.yaml/badge.svg)](https://github.com/SkywardAI/chat-backend/actions/workflows/linter-and-builder.yaml) [![Release Drafter 🚀](https://github.com/SkywardAI/chat-backend/actions/workflows/release-drafter.yml/badge.svg)](https://github.com/SkywardAI/chat-backend/actions/workflows/release-drafter.yml) [![Releasing Image 🚀](https://github.com/SkywardAI/kirin/actions/workflows/release-image.yaml/badge.svg)](https://github.com/SkywardAI/kirin/actions/workflows/release-image.yaml) [![CodeQL](https://github.com/SkywardAI/kirin/actions/workflows/github-code-scanning/codeql/badge.svg)](https://github.com/SkywardAI/kirin/actions/workflows/github-code-scanning/codeql)\n\n\n\u003e[!Warning]\n\u003e**Kirin is currently in Development**: Expect breaking changes and bugs!\n\n\n# Architecture\n\n![](./imgs/SkywardAI(Mind%20Map)%20-%20APIs%20aggregator.svg)\n\n\n# Doing inference on 12 CPUs\n\nhttps://github.com/user-attachments/assets/3890b4cd-392b-489f-ad48-4e9692d4dc15\n\n\n# Roadmap\n\n- [x] **Inference mode(default)**: Chat with the small language model at consumer grade hardware with 8 CPUs\n- [x] **RAG mode**: Chat with small language model based on pre-processed datasets\n- [x] **CRM feature**s: Multiple users login, chat/chat(RAG), save chat history and share the chat history by JSON format\n- [ ] **Neural Network define**\n     - [ ] Pre-define neural network as template, support load weights and fine-tune\n     - [ ] Support multiple neural network types\n     - [ ] Support custom simple neural network by UI\n\n- [ ] **Training Factory**\n     - [ ] Train the neural network with the given dataset  \n     - [ ] Quantize the model and upload it to the server with the given tokens  \n     - [ ] Visualize the neural network and the training process\n\n\n# Requirements\n\nYou need to make sure Docker and docker-compose on your environment. See [Requirements.md](./docs/Requirements.md)\n\n\n# Quick setup\n\nIf you want to setup the project quickly, please follow the steps below:\n\nPlease check the [Requirements.md](./docs/Requirements.md) to prepare you env\n\n```\ngit clone https://github.com/SkywardAI/kirin.git\n\ncd kirin\n\nmake demo\n```\n\n\n# Build and deployment\n\n\u003c!-- https://stackoverflow.com/questions/2068344/how-do-i-get-a-youtube-video-thumbnail-from-the-youtube-api --\u003e\n\n[![Build and Deployment](https://img.youtube.com/vi/63OxSmcBkhI/0.jpg)](https://youtu.be/63OxSmcBkhI?si=G82BOtcwRvQE7dLU)\n\nAnd if you are interested in docker-in-docker development, see [Development.md](./docs/Development.md)\n\n\n# Tech stack\n\nThis is a repository is the API aggregator of SkywardAI. It's using the following tech stack:\n\n* 🐳 [Dockerized](https://www.docker.com/)\n* 🐘 [Asynchronous PostgreSQL](https://www.postgresql.org/docs/current/libpq-async.html)\n* 🐍 [FastAPI](https://fastapi.tiangolo.com/)\n\nWhen the `Docker` is started, these are the URL addresses:\n\n* Backend Application (API docs) $\\rightarrow$ `http://localhost:8000/docs`\n* Database editor (Adminer) $\\rightarrow$ `http//localhost:8081`\n\n## Why the above Tech-Stack?\n\nWell, the easy answer is **Asynchronousity** and **Speed**!\n\n* **FastAPI** is crowned as the fastest web framework for Python and thus we use it for our backend development.\n* **Docker** is a technology that packages an application into standardized units called containers that have everything the software needs to run including libraries, system tools, code, and runtime.\n\n\n## Other Technologies\n\nThe above-listed technologies are just the main ones. There are other technologies utilized in this project template to ensure that your application is robust and provides the best possible development environment for your team! These technologies are:\n\n* [CodeCov](https://about.codecov.io/) $\\rightarrow$ A platform that analyzes the result of your automated tests.\n* [PyTest](https://docs.pytest.org/en/7.2.x/) $\\rightarrow$ The testing framework for Python code.\n* [DBDiagram](https://dbdiagram.io/home) $\\rightarrow$ A platform that lets your design your database by writing SQL and converting it into ERD. This platform provides a complete symbol for entity relationships (not like many other platforms!).\n* [GitHub Actions](https://github.com/features/actions) $\\rightarrow$ The platform to setup our CI/CD by GitHub.\n* [CODEOWNERS](https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/about-code-owners) $\\rightarrow$ A file for distributing the responsibilities in our project to each team/teammate.\n\n\n## Acknowledgements\n\n* [LocalAI](https://github.com/mudler/LocalAI)\n* [FastAPI](https://fastapi.tiangolo.com/)\n* [llama.cpp](https://github.com/ggerganov/llama.cpp)\n* [LanceDB](https://lancedb.github.io/lancedb/)\n* [HuggingFace Community](https://huggingface.co/aisuko)\n* [RMIT Race Hub](https://race.rmit.edu.au)\n* [Microsoft Phi-3 Series](https://huggingface.co/aisuko/Phi-3-mini-4k-instruct-gguf)\n\n\n# LICENSE\n\nThis project is licensed under the terms of the Apache 2.0 license. See the [LICENSE](./LICENSE.md) file.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fskywardai%2Fkirin","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fskywardai%2Fkirin","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fskywardai%2Fkirin/lists"}