https://github.com/wangzongming/esp-ai
The simplest and lowest-cost AI integration solution. If you like this project, please give it a Star~ | 最简单、最低成本的AI接入方案。喜欢本项目的话点个 Star 吧~
https://github.com/wangzongming/esp-ai
aiot arduino arduino-llm esp-ai esp32 esp32-ai esp32-idf esp32-llm esp8266 iat llm rag tts
Last synced: 28 days ago
JSON representation
The simplest and lowest-cost AI integration solution. If you like this project, please give it a Star~ | 最简单、最低成本的AI接入方案。喜欢本项目的话点个 Star 吧~
- Host: GitHub
- URL: https://github.com/wangzongming/esp-ai
- Owner: wangzongming
- License: mit
- Created: 2024-06-26T06:39:06.000Z (11 months ago)
- Default Branch: master
- Last Pushed: 2025-04-04T17:29:29.000Z (about 1 month ago)
- Last Synced: 2025-04-06T16:02:35.748Z (about 1 month ago)
- Topics: aiot, arduino, arduino-llm, esp-ai, esp32, esp32-ai, esp32-idf, esp32-llm, esp8266, iat, llm, rag, tts
- Language: HTML
- Homepage: https://espai.fun
- Size: 252 MB
- Stars: 729
- Watchers: 10
- Forks: 79
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
ESP-AI
硬件接入AI最简单、最低成本的方案
The simplest and lowest cost solution for any item to access AI
[![NPM version][npm-image]][npm-url]
[![NPM downloads][download-image]][download-url]
[![][bundlephobia-image]][bundlephobia-url]
[Changelog](https://espai.fun/change-logs.html) ·
[中文文档](https://espai.fun/) ·
[English Docs](https://espai.fun/en)
[npm-image]: https://img.shields.io/npm/v/esp-ai.svg?style=flat-square
[npm-url]: https://npmjs.org/package/esp-ai
[download-url]: https://npmjs.org/package/esp-ai
[bundlephobia-image]: https://badgen.net/bundlephobia/minzip/esp-ai?style=flat-square
[download-image]: https://img.shields.io/npm/dm/esp-ai.svg?style=flat
[bundlephobia-url]: https://bundlephobia.com/package/esp-ai
# language
👉简体中文
👉Japanese
# Intro
> Provides a complete AI dialogue solution for your development board, including but not limited to the `IAT(ASR)+LLM+TTS` integration solution for the `ESP32` series development boards. It is injected into the project as a dependency without affecting existing projects.
For developing the dialogue functionality of robots, you only need to prepare the `IAT(ASR)`, `LLM`, and `TTS` services, and leave the rest to `ESP-AI`.
The server-side code of this project is based on `Node.js`, and the hardware code is based on `Arduino`/`IDF`.
Open source is not easy, click the `Star` button in the upper right corner to show your support~
# 🖥 Website
- [中文网站](https://espai.fun/)
- [English](https://espai.fun/en)
# 🖥 open platform
A platform based on ESP-AI that provides end services and management services to businesses and individuals. [Visit the Open Platform](https://dev.espai.fun/).
It offers free ASR (Automatic Speech Recognition), TTS (Text-to-Speech), and LLM (Large Language Model) services. On this platform, you can clone a custom voice with just a 15-second audio clip.
# ✨ Features
- ✔️ Customizable offline wake words with multiple built-in wake-up methods (voice, button, serial port, Tianwen ASRPro)
- ✔️ Complete conversation chain: IAT (ASR) ➡️ LLM/RAG ➡️ TTS
- ✔️ Fast response algorithms for TTS/LLM, designed to balance service cost while providing the quickest response time
- ✔️ Supports conversation interruption
- ✔️ Recognizes user commands (appliance control, singing, etc.) and can dynamically respond based on context
- ✔️ Configurable
- ✔️ Plugin-based, allowing integration with any LLM/TTS/IAT using plugins
- ✔️ One-to-many relationship between service and clients, with independent configuration for each client (hardware)
- ✔️ Connection supports authentication
- ✔️ Full-chain streaming data interaction
- ✔️ Developer platform offers: free services, visual configuration, etc.
- ✔️ Client configuration webpage provided
- ✔️ Easily handles high concurrency scenarios (requires Nginx for load balancing)
- ✔️ Ready to use out of the box
# 🧐 Next Steps
- [ ] 🤔 Improve accuracy of built-in offline wake-up (currently recommended to use Tianwen ASRPro)
- [ ] 🤔 Online wake word generation
- [ ] 🤔 Develop plugins in other languages (to avoid relying solely on Node.js for plugin development)
# 📦 Install
### Server
```bash
docker run -itd -p 8088:8088 -v /esp-ai-server/index.js:/server/index.js --name esp-ai-server registry.cn-shanghai.aliyuncs.com/xiaomingio/esp-ai:1.0.0
```
### Client
Download the dependency on the release page and burn it to the development board, see details: [Client Install](https://espai.fun/start.html#%E5%AE%A2%E6%88%B7%E7%AB%AF)
# 🔨 Inject Soul into Your Robot with Just a Few Lines of Code
Below are the `Node.js` and `Arduino` codes you need to write if you only require dialogue functionality.
# 🏪 Discussion Group
QQ Discussion Group: 854445223
# 🎥 Case Study Video
[bilibili](https://www.bilibili.com/video/BV1gE421w7Dw/?share_source=copy_web&vd_source=041c9610a29750f498de1bafe953086b)
## 🤝 Contributing [](http://makeapullrequest.com)
Let's build a better `esp-ai` together.
We warmly invite contributions from everyone. Feel free to share your ideas through [Pull Requests](https://github.com/wangzongming/esp-ai/pulls) or [GitHub Issues](https://github.com/wangzongming/esp-ai//issues).
# 🌍 Star geographical distribution
# quote
If this project has helped your research, please cite us:
@software{ESP-AI,
title = {{ESP-AI}},
author = {小明IO},
year = 2024,
journal = {GitHub repository},
publisher = {GitHub},
howpublished = {\url{https://github.com/wangzongming/esp-ai}}
}