https://github.com/jasonyang170/aiot-phone

MCU与多模态模型的结合
https://github.com/jasonyang170/aiot-phone

Last synced: about 1 month ago
JSON representation

MCU与多模态模型的结合

• Host: GitHub
• URL: https://github.com/jasonyang170/aiot-phone
• Owner: JasonYANG170
• Created: 2024-08-28T04:06:55.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-09-12T07:15:57.000Z (8 months ago)
• Last Synced: 2025-03-23T16:42:43.261Z (2 months ago)
• Language: C++
• Size: 2.61 MB
• Stars: 22
• Watchers: 3
• Forks: 5
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        


    
AIOT-Phone多模态大模型AI终端设备


![Static Badge](https://img.shields.io/badge/License-CC_BY_NC_SA_4.0-green?style=for-the-badge)

![Commit Activity](https://img.shields.io/github/commit-activity/w/JasonYANG170/AIOT-Phone?style=for-the-badge&color=yellow)![Languages Count](https://img.shields.io/github/languages/count/JasonYANG170/AIOT-Phone?logo=c&style=for-the-badge)

[![Discord](https://img.shields.io/discord/978108215499816980?style=social&logo=discord&label=echosec)](https://discord.com/invite/az3ceRmgVe)

这是一项基于C语言的多模态大模型AI终端设备



[![ESP32 LVGL Chat with AI](https://res.cloudinary.com/marcomontalbano/image/upload/v1724820150/video_to_markdown/images/youtube--R_B1rzzal6A-c05b58ac6eb4c4700831b2b3070cd403.jpg)](https://youtu.be/R_B1rzzal6A "ESP32 LVGL Chat with AI")

[无法播放请点此使用BiliBili](https://www.bilibili.com/video/BV1UqsNeJE3j/)

## 功能

- ✅支持环境视觉识别

- ✅支持语音交互

- ✅支持语音播放

- ✅支持多国语音

- ✅支持多模态大模型

- ✅支持LVGL9.1

- ✅支持触摸屏交互

- ✅支持屏幕亮度调节。

如遇问题，请向我提出issues

## 项目参数

* 本设计采用OV2640摄像头，以实现对环境的视觉采样；

* 本设计采用max98357音频芯片，以实现应答语音播放；

* 本设计采用INMP441全向麦风，以实现环境音频采样；

* 本项目支持MQTT服务功能，您可接入您的MQTT服务器并可以使用我开发的开源客户端控制

* 本项目设及的服务我会在Github提供doceker-compose.yml文件，方便一键部署

## 开源协议

本项目遵循CC BY-NC-SA 4.0开源协议，使用本程序时请注明出处并进行版权声明  

本项目仅供学习研究与学习，严禁非授权的商业获利，  

如果您有更好的建议，欢迎PR

## 喜欢这个项目，请为我点个Star ⭐

[![Star History Chart](https://api.star-history.com/svg?repos=JasonYANG170/AIOT-Phone&type=Date)](https://star-history.com/#star-history/star-history&Date)

## 实物图

| 1 | 2 |

| --- | --- |

|![5181f6d7c68fe5cc31673a2e0d8071f](https://github.com/user-attachments/assets/77312328-9843-4ee8-a2ea-59112cdd147a)|![6b2c1da903099bfe7ce53477610a229](https://github.com/user-attachments/assets/dde4aa6e-dc33-499c-bd8a-128613c258ce)|

|![01d707e478b931b0958bd30d4e020cc](https://github.com/user-attachments/assets/5ed8617b-b2c3-4c21-9647-3db4341c9944)|![86d2205ab37787efd5aef429db36118](https://github.com/user-attachments/assets/ba885e87-426a-4daf-be02-769aa344a35e)|

|![3a8b6ff10a777a191f7fc093dbcbc1b](https://github.com/user-attachments/assets/3480c34d-60f3-4a0b-9ea1-71deda60c4ab)|![77465f6cea63967e52ca40b6a876a90](https://github.com/user-attachments/assets/759c3f38-63ab-4405-bbab-91cf3d94750b)|