{"id":42038747,"url":"https://github.com/epuerta9/kitchenai","last_synced_at":"2026-01-26T05:30:38.082Z","repository":{"id":259220583,"uuid":"867149056","full_name":"epuerta9/kitchenai","owner":"epuerta9","description":"Open Source LLMOps tool for AI teams","archived":false,"fork":false,"pushed_at":"2025-02-14T03:52:06.000Z","size":20499,"stargazers_count":126,"open_issues_count":6,"forks_count":7,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-09-25T02:45:26.198Z","etag":null,"topics":["ai","devops","devops-tools","llm","llm-inference","llmops","open-source","testing-tools","tools"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/epuerta9.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-03T14:34:24.000Z","updated_at":"2025-09-08T17:14:11.000Z","dependencies_parsed_at":"2024-10-26T19:48:44.879Z","dependency_job_id":null,"html_url":"https://github.com/epuerta9/kitchenai","commit_stats":null,"previous_names":["epuerta9/kitchenai"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/epuerta9/kitchenai","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/epuerta9%2Fkitchenai","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/epuerta9%2Fkitchenai/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/epuerta9%2Fkitchenai/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/epuerta9%2Fkitchenai/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/epuerta9","download_url":"https://codeload.github.com/epuerta9/kitchenai/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/epuerta9%2Fkitchenai/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28767248,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-26T03:54:34.369Z","status":"ssl_error","status_checked_at":"2026-01-26T03:54:33.031Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","devops","devops-tools","llm","llm-inference","llmops","open-source","testing-tools","tools"],"created_at":"2026-01-26T05:30:37.542Z","updated_at":"2026-01-26T05:30:38.077Z","avatar_url":"https://github.com/epuerta9.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# KitchenAI\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"docs/_static/images/logo.png\" alt=\"KitchenAI\" width=\"100\" height=\"100\"\u003e\n\u003c/p\u003e\n\n**KitchenAI** is a control plane for AI implementations — designed to bridge the gap between application developers and AI teams. Our platform simplifies AI integration with a loosely coupled, modular architecture that delivers production-grade reliability while letting your teams focus on what they do best.\n\n---\n\n## 🚀 Quick Start\n\n- **Explore Our Interactive Playground:**  \n  [Try KitchenAI in Action](https://playground.kitchenai.dev/apps/playground)\n- **Take a Guided Tour:**  \n  [Watch the Guided Tour](https://app.arcade.software/share/j5ORenX65H5xuZWRppR4)\n\n---\n\n## 🌟 What Makes KitchenAI Unique\n\n### Modular Architecture\n- **Bento Boxes:** Package your AI workflows into independent \"bento boxes\" that encapsulate complex logic.  \n- **Flexibility:** Update, replace, or scale individual modules without disrupting your overall system.  \n- **Clear Separation:** Let AI teams build advanced logic in a reproducible and swappable space, while app developers enjoy a simple, stable API.\n\n### High-Performance Messaging\n- **Powered by NATS:**  \n  - Lightning-fast, reliable communication between AI modules  \n  - Dynamic service discovery and routing  \n  - Robust support for event-driven workflows in distributed environments\n\n### Framework Agnostic\n- **Plug \u0026 Play:**  \n  - No vendor lock-in—integrate with any AI framework or model  \n  - Native support for LangChain, LlamaIndex, and custom implementations  \n  - Future-proof your AI infrastructure with flexible integration options\n\n---\n\n## 🛠️ How It Works\n\nKitchenAI’s three-layer architecture makes it easy to manage your AI workflows:\n\n1. **Application Layer:**  \n   Your business applications call a simple, unified API (just like using OpenAI’s Chat Completions).\n   \n2. **NATS Messaging Layer:**  \n   This is our high-performance backbone for routing messages and discovering services dynamically.\n   \n3. **Bento Boxes Layer:**  \n   Modular AI implementations where your AI team builds the complex logic (be it LLM logic, RAG, agents, or custom workflows).\n\n### For Application Developers\nYour code remains clean and simple:\n\n```python\n    # Simple integration using OpenAI's Chat Completions\n    response = await openai_client.chat.completions.create(\n        model=\"@llama-index-agents/query\", #your bento box client id \n        messages=[{\"role\": \"user\", \"content\": data.query}]\n    )\n```\n\n### For AI Teams\nFocus on building powerful AI code:\n\n```python\n@kitchen.query.handler(\"query\")\nasync def query_handler(data: WhiskQuerySchema) -\u003e WhiskQueryBaseResponseSchema:\n    # Advanced RAG implementation with best practices built-in\n    index = VectorStoreIndex.from_vector_store(vector_store)\n    query_engine = index.as_query_engine(\n        chat_mode=\"best\",\n        filters=filters,\n        llm=llm,\n        verbose=True\n    )\n```\n\n---\n## Self hosting the control plane \n\nKitchenAI is designed to be self-hosted. You can deploy the control plane and the bento boxes separately.\n\n\n\n1. Clone the KitchenAI repository\n```bash\ngit clone https://github.com/epuerta9/kitchenai.git\n```\n\n2. Bring up the control plane and dependencies\n```bash\ndocker compose up -d\n```\n\n4. Creating the Bucket for media. KitchenAI uses S3 for media. For local development, the compose file has a minio container. This only needs to be done the first time. \n\nyou will need to login to the minio container and create a bucket called `kitchenai`.\n\nendpoint: http://localhost:9001\nusername: minioadmin\npassword: minioadmin\n\nbucket name: kitchenai\n\n3. Bring up the bento boxes using this demo [demo notebooks](https://github.com/epuerta9/kitchenai-demo)\n---\n\n## Settings\n\navailable environment variables\n```\n      OPENAI_API_KEY: ${OPENAI_API_KEY}\n      DEBUG: \"False\"\n      KITCHENAI_LOCAL: \"False\"\n      KITCHENAI_LICENSE: \"oss\"\n      ALLOWED_HOSTS: \"*\"\n      CSRF_TRUSTED_ORIGINS: \"\"\n      CACHE_LOCATION: \"\"\n      KITCHENAI_REDIS_CACHE: \"False\"\n      REDIS_LOCATION: \"redis://127.0.0.1:6379/1\"\n      DATABASE_URL: \"postgres://postgres:postgres@postgres:5432/postgres\"\n      CONN_MAX_AGE: \"60\"\n      DEFAULT_FROM_EMAIL: \"example@example.com\"\n      SECRET_KEY: \"django-insecure-ef6nIh7LcUjPtixFdz0_aXyUwlKqvBdJEcycRR6RvRY\"\n      MEDIA_ROOT: \"./media\"\n      SECURE_HSTS_SECONDS: \"120\"\n      SECURE_HSTS_INCLUDE_SUBDOMAINS: \"True\"\n      SECURE_HSTS_PRELOAD: \"True\"\n      SESSION_COOKIE_SECURE: \"True\"\n      SERVER_EMAIL: \"example@example.com\"\n      AWS_ACCESS_KEY_ID: \"minioadmin\"\n      AWS_SECRET_ACCESS_KEY: \"minioadmin\"\n      AWS_STORAGE_BUCKET_NAME: \"kitchenai\"\n      AWS_S3_ENDPOINT_URL: \"http://minio:9000\"\n      AWS_DEFAULT_REGION: \"us-east-1\"\n      AWS_S3_ADDRESSING_STYLE: \"path\"\n      AWS_S3_USE_SSL: \"True\"\n      AWS_S3_VERIFY: \"True\"\n      USE_S3: \"False\"\n      DJANGO_ALLOW_REGISTRATION: \"True\"\n      RESEND_API_KEY: \"\"\n      ADMIN_URL: \"kitchenai-admin/\"\n      KITCHENAI_LLM_PROVIDER: \"openai\"\n      KITCHENAI_LLM_MODEL: \"gpt-4o\"\n      KITCHENAI_AUTH: \"False\"\n      KITCHENAI_JWT_SECRET: \"\"\n      WHISK_USER: \"kitchenai\"\n      WHISK_PASSWORD: \"kitchenai_admin\"\n      NATS_URL: \"nats://nats:4222\"\n      KITCHENAI_THEME: \"winter\"\n      MEDIA_BASE_URL: \"http://localhost:8080\"\n```\n\n\n## 📚 Documentation\n\n- [Getting Started](https://kitchenai.dev/docs/getting-started)\n- [Core Concepts](https://kitchenai.dev/docs/core-concepts)\n- [Deployment Guide](https://kitchenai.dev/docs/deployment)\n- [API Reference](https://kitchenai.dev/docs/api-reference)\n\n---\n\n## 🛠️ Key Features\n\n- **Version Control \u0026 Rollback:** Safely iterate and revert as needed.\n- **Monitoring \u0026 Observability Hooks:** Integrate with your favorite tools.\n- **Plugin Ecosystem:** Extend KitchenAI with additional capabilities.\n- **Security Integrations:** Designed with production-grade best practices.\n\n---\n\n## 🙋‍♂️ Join the Beta!\n\nKitchenAI is still in beta—we're excited to have early adopters help shape the platform.  \n- **Join the Waitlist:** [Get Early Access](https://kitchenai.dev/#waitlist)  \n- **Play in Our Playground:** [Try it out now](https://playground.kitchenai.dev)\n\n---\n\n## 🔗 Quick Links\n\n- [Website](https://kitchenai.dev)\n- [Documentation](https://kitchenai.dev/docs)\n- [Interactive Playground](https://playground.kitchenai.dev)\n- [GitHub](https://github.com/epuerta9/kitchenai)\n\n---\n\n## 📄 License\n\nKitchenAI is released under the [Apache 2.0 License](LICENSE).\n\n---\n\n## 🙋‍♂️ Support \u0026 Community\n\n- [Community Forum](https://kitchenai.dev/community)\n- [GitHub Issues](https://github.com/epuerta9/kitchenai/issues)\n- [Email Support](mailto:support@kitchenai.dev)\n\n---\n\n\u003cp align=\"center\"\u003e\n  Built with ❤️ by the KitchenAI Team\n\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fepuerta9%2Fkitchenai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fepuerta9%2Fkitchenai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fepuerta9%2Fkitchenai/lists"}