{"id":17982760,"url":"https://github.com/78/xiaozhi-esp32","last_synced_at":"2025-05-14T22:02:26.991Z","repository":{"id":255820892,"uuid":"850267588","full_name":"78/xiaozhi-esp32","owner":"78","description":"Build your own AI friend","archived":false,"fork":false,"pushed_at":"2025-05-07T18:32:36.000Z","size":2804,"stargazers_count":12491,"open_issues_count":171,"forks_count":2457,"subscribers_count":97,"default_branch":"main","last_synced_at":"2025-05-07T21:16:20.905Z","etag":null,"topics":["chatbot","esp32","llm"],"latest_commit_sha":null,"homepage":"https://xiaozhi.me","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/78.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-08-31T10:08:16.000Z","updated_at":"2025-05-07T18:32:43.000Z","dependencies_parsed_at":"2024-09-17T06:45:41.857Z","dependency_job_id":"93c9b55b-c361-4769-80f0-951b9d3d4bd8","html_url":"https://github.com/78/xiaozhi-esp32","commit_stats":null,"previous_names":["78/xiaozhi-esp32"],"tags_count":39,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/78%2Fxiaozhi-esp32","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/78%2Fxiaozhi-esp32/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/78%2Fxiaozhi-esp32/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/78%2Fxiaozhi-esp32/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/78","download_url":"https://codeload.github.com/78/xiaozhi-esp32/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254235685,"owners_count":22036962,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chatbot","esp32","llm"],"created_at":"2024-10-29T18:15:05.353Z","updated_at":"2025-05-14T22:02:26.934Z","avatar_url":"https://github.com/78.png","language":"C++","funding_links":[],"categories":["C++","📚 Projects (1974 total)","Repos","Chatbots \u0026 Virtual Companions"],"sub_categories":["MCP Servers"],"readme":"# 小智 AI 聊天机器人 （XiaoZhi AI Chatbot）\n\n（中文 | [English](README_en.md) | [日本語](README_ja.md)）\n\n## 视频介绍\n\n👉 [ESP32+SenseVoice+Qwen72B打造你的AI聊天伴侣！【bilibili】](https://www.bilibili.com/video/BV11msTenEH3/)\n\n👉 [给小智装上 DeepSeek 的聪明大脑【bilibili】](https://www.bilibili.com/video/BV1GQP6eNEFG/)\n\n👉 [手工打造你的 AI 女友，新手入门教程【bilibili】](https://www.bilibili.com/video/BV1XnmFYLEJN/)\n\n## 项目目的\n\n本项目是由虾哥开源的一个开源项目，以 MIT 许可证发布，允许任何人免费使用，并可以用于商业用途。\n\n我们希望通过这个项目，能够帮助更多人入门 AI 硬件开发，了解如何将当下飞速发展的大语言模型应用到实际的硬件设备中。无论你是对 AI 感兴趣的学生，还是想要探索新技术的开发者，都可以通过这个项目获得宝贵的学习经验。\n\n欢迎所有人参与到项目的开发和改进中来。如果你有任何想法或建议，请随时提出 Issue 或加入群聊。\n\n学习交流 QQ 群：376893254\n\n## 已实现功能\n\n- Wi-Fi / ML307 Cat.1 4G\n- BOOT 键唤醒和打断，支持点击和长按两种触发方式\n- 离线语音唤醒 [ESP-SR](https://github.com/espressif/esp-sr)\n- 流式语音对话（WebSocket 或 UDP 协议）\n- 支持国语、粤语、英语、日语、韩语 5 种语言识别 [SenseVoice](https://github.com/FunAudioLLM/SenseVoice)\n- 声纹识别，识别是谁在喊 AI 的名字 [3D Speaker](https://github.com/modelscope/3D-Speaker)\n- 大模型 TTS（火山引擎 或 CosyVoice）\n- 大模型 LLM（Qwen, DeepSeek, Doubao）\n- 可配置的提示词和音色（自定义角色）\n- 短期记忆，每轮对话后自我总结\n- OLED / LCD 显示屏，显示信号强弱或对话内容\n- 支持 LCD 显示图片表情\n- 支持多语言（中文、英文）\n\n## 硬件部分\n\n### 面包板手工制作实践\n\n详见飞书文档教程：\n\n👉 [《小智 AI 聊天机器人百科全书》](https://ccnphfhqs21z.feishu.cn/wiki/F5krwD16viZoF0kKkvDcrZNYnhb?from=from_copylink)\n\n面包板效果图如下：\n\n![面包板效果图](docs/wiring2.jpg)\n\n### 已支持的开源硬件\n\n- \u003ca href=\"https://oshwhub.com/li-chuang-kai-fa-ban/li-chuang-shi-zhan-pai-esp32-s3-kai-fa-ban\" target=\"_blank\" title=\"立创·实战派 ESP32-S3 开发板\"\u003e立创·实战派 ESP32-S3 开发板\u003c/a\u003e\n- \u003ca href=\"https://github.com/espressif/esp-box\" target=\"_blank\" title=\"乐鑫 ESP32-S3-BOX3\"\u003e乐鑫 ESP32-S3-BOX3\u003c/a\u003e\n- \u003ca href=\"https://docs.m5stack.com/zh_CN/core/CoreS3\" target=\"_blank\" title=\"M5Stack CoreS3\"\u003eM5Stack CoreS3\u003c/a\u003e\n- \u003ca href=\"https://docs.m5stack.com/en/atom/Atomic%20Echo%20Base\" target=\"_blank\" title=\"AtomS3R + Echo Base\"\u003eAtomS3R + Echo Base\u003c/a\u003e\n- \u003ca href=\"https://docs.m5stack.com/en/core/ATOM%20Matrix\" target=\"_blank\" title=\"AtomMatrix + Echo Base\"\u003eAtomMatrix + Echo Base\u003c/a\u003e\n- \u003ca href=\"https://gf.bilibili.com/item/detail/1108782064\" target=\"_blank\" title=\"神奇按钮 2.4\"\u003e神奇按钮 2.4\u003c/a\u003e\n- \u003ca href=\"https://www.waveshare.net/shop/ESP32-S3-Touch-AMOLED-1.8.htm\" target=\"_blank\" title=\"微雪电子 ESP32-S3-Touch-AMOLED-1.8\"\u003e微雪电子 ESP32-S3-Touch-AMOLED-1.8\u003c/a\u003e\n- \u003ca href=\"https://github.com/Xinyuan-LilyGO/T-Circle-S3\" target=\"_blank\" title=\"LILYGO T-Circle-S3\"\u003eLILYGO T-Circle-S3\u003c/a\u003e\n- \u003ca href=\"https://oshwhub.com/tenclass01/xmini_c3\" target=\"_blank\" title=\"虾哥 Mini C3\"\u003e虾哥 Mini C3\u003c/a\u003e\n- \u003ca href=\"https://oshwhub.com/movecall/moji-xiaozhi-ai-derivative-editi\" target=\"_blank\" title=\"Movecall Moji ESP32S3\"\u003eMoji 小智AI衍生版\u003c/a\u003e\n- \u003ca href=\"https://oshwhub.com/movecall/cuican-ai-pendant-lights-up-y\" target=\"_blank\" title=\"Movecall CuiCan ESP32S3\"\u003e璀璨·AI吊坠\u003c/a\u003e\n- \u003ca href=\"https://github.com/WMnologo/xingzhi-ai\" target=\"_blank\" title=\"无名科技Nologo-星智-1.54\"\u003e无名科技Nologo-星智-1.54TFT\u003c/a\u003e\n- \u003ca href=\"https://www.seeedstudio.com/SenseCAP-Watcher-W1-A-p-5979.html\" target=\"_blank\" title=\"SenseCAP Watcher\"\u003eSenseCAP Watcher\u003c/a\u003e\n\u003cdiv style=\"display: flex; justify-content: space-between;\"\u003e\n  \u003ca href=\"docs/v1/lichuang-s3.jpg\" target=\"_blank\" title=\"立创·实战派 ESP32-S3 开发板\"\u003e\n    \u003cimg src=\"docs/v1/lichuang-s3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/espbox3.jpg\" target=\"_blank\" title=\"乐鑫 ESP32-S3-BOX3\"\u003e\n    \u003cimg src=\"docs/v1/espbox3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/m5cores3.jpg\" target=\"_blank\" title=\"M5Stack CoreS3\"\u003e\n    \u003cimg src=\"docs/v1/m5cores3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/atoms3r.jpg\" target=\"_blank\" title=\"AtomS3R + Echo Base\"\u003e\n    \u003cimg src=\"docs/v1/atoms3r.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/magiclick.jpg\" target=\"_blank\" title=\"神奇按钮 2.4\"\u003e\n    \u003cimg src=\"docs/v1/magiclick.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/waveshare.jpg\" target=\"_blank\" title=\"微雪电子 ESP32-S3-Touch-AMOLED-1.8\"\u003e\n    \u003cimg src=\"docs/v1/waveshare.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/lilygo-t-circle-s3.jpg\" target=\"_blank\" title=\"LILYGO T-Circle-S3\"\u003e\n    \u003cimg src=\"docs/lilygo-t-circle-s3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/xmini-c3.jpg\" target=\"_blank\" title=\"虾哥 Mini C3\"\u003e\n    \u003cimg src=\"docs/xmini-c3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/movecall-moji-esp32s3.jpg\" target=\"_blank\" title=\"Movecall Moji 小智AI衍生版\"\u003e\n    \u003cimg src=\"docs/v1/movecall-moji-esp32s3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/movecall-cuican-esp32s3.jpg\" target=\"_blank\" title=\"CuiCan\"\u003e\n    \u003cimg src=\"docs/v1/movecall-cuican-esp32s3.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/wmnologo_xingzhi_1.54.jpg\" target=\"_blank\" title=\"无名科技Nologo-星智-1.54\"\u003e\n    \u003cimg src=\"docs/v1/wmnologo_xingzhi_1.54.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n  \u003ca href=\"docs/v1/sensecap_watcher.jpg\" target=\"_blank\" title=\"SenseCAP Watcher\"\u003e\n    \u003cimg src=\"docs/v1/sensecap_watcher.jpg\" width=\"240\" /\u003e\n  \u003c/a\u003e\n\u003c/div\u003e\n\n## 固件部分\n\n### 免开发环境烧录\n\n新手第一次操作建议先不要搭建开发环境，直接使用免开发环境烧录的固件。\n\n固件默认接入 [xiaozhi.me](https://xiaozhi.me) 官方服务器，目前个人用户注册账号可以免费使用 Qwen 实时模型。\n\n👉 [Flash烧录固件（无IDF开发环境）](https://ccnphfhqs21z.feishu.cn/wiki/Zpz4wXBtdimBrLk25WdcXzxcnNS) \n\n\n### 开发环境\n\n- Cursor 或 VSCode\n- 安装 ESP-IDF 插件，选择 SDK 版本 5.3 或以上\n- Linux 比 Windows 更好，编译速度快，也免去驱动问题的困扰\n- 使用 Google C++ 代码风格，提交代码时请确保符合规范\n\n### 开发者文档\n\n- [开发板定制指南](main/boards/README.md) - 学习如何为小智创建自定义开发板适配\n- [物联网控制模块](main/iot/README.md) - 了解如何通过AI语音控制物联网设备\n\n\n## 智能体配置\n\n如果你已经拥有一个小智 AI 聊天机器人设备，可以登录 [xiaozhi.me](https://xiaozhi.me) 控制台进行配置。\n\n👉 [后台操作视频教程（旧版界面）](https://www.bilibili.com/video/BV1jUCUY2EKM/)\n\n## 技术原理与私有化部署\n\n👉 [一份详细的 WebSocket 通信协议文档](docs/websocket.md)\n\n在个人电脑上部署服务器，可以参考另一位作者同样以 MIT 许可证开源的项目 [xiaozhi-esp32-server](https://github.com/xinnan-tech/xiaozhi-esp32-server)\n\n## Star History\n\n\u003ca href=\"https://star-history.com/#78/xiaozhi-esp32\u0026Date\"\u003e\n \u003cpicture\u003e\n   \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"https://api.star-history.com/svg?repos=78/xiaozhi-esp32\u0026type=Date\u0026theme=dark\" /\u003e\n   \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"https://api.star-history.com/svg?repos=78/xiaozhi-esp32\u0026type=Date\" /\u003e\n   \u003cimg alt=\"Star History Chart\" src=\"https://api.star-history.com/svg?repos=78/xiaozhi-esp32\u0026type=Date\" /\u003e\n \u003c/picture\u003e\n\u003c/a\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F78%2Fxiaozhi-esp32","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F78%2Fxiaozhi-esp32","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F78%2Fxiaozhi-esp32/lists"}