{"id":24603602,"url":"https://github.com/open-llm-vtuber/open-llm-vtuber","last_synced_at":"2025-05-14T01:02:11.811Z","repository":{"id":212574310,"uuid":"722844356","full_name":"Open-LLM-VTuber/Open-LLM-VTuber","owner":"Open-LLM-VTuber","description":"Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms","archived":false,"fork":false,"pushed_at":"2025-03-27T06:36:37.000Z","size":33230,"stargazers_count":3026,"open_issues_count":50,"forks_count":315,"subscribers_count":26,"default_branch":"main","last_synced_at":"2025-04-05T18:01:35.777Z","etag":null,"topics":["ai","ai-companion","ai-vtuber","ai-waifu","chatbots","live2d","live2d-web","llm","neuro-sama","ollama"],"latest_commit_sha":null,"homepage":"https://open-llm-vtuber.github.io/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Open-LLM-VTuber.png","metadata":{"files":{"readme":"README.CN.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":null,"patreon":null,"open_collective":null,"ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"lfx_crowdfunding":null,"polar":null,"buy_me_a_coffee":"yi.ting","custom":null}},"created_at":"2023-11-24T04:55:43.000Z","updated_at":"2025-04-05T18:00:02.000Z","dependencies_parsed_at":"2023-12-15T03:01:37.767Z","dependency_job_id":"5a1c38e0-214c-4943-9f22-c1d018ef2d2c","html_url":"https://github.com/Open-LLM-VTuber/Open-LLM-VTuber","commit_stats":{"total_commits":326,"total_committers":4,"mean_commits":81.5,"dds":"0.012269938650306789","last_synced_commit":"fcbbac0eaed9a4e4ab6e88a9e2fac951fd7f4cad"},"previous_names":["t41372/open-llm-vtuber","open-llm-vtuber/open-llm-vtuber"],"tags_count":17,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-LLM-VTuber%2FOpen-LLM-VTuber","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-LLM-VTuber%2FOpen-LLM-VTuber/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-LLM-VTuber%2FOpen-LLM-VTuber/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-LLM-VTuber%2FOpen-LLM-VTuber/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Open-LLM-VTuber","download_url":"https://codeload.github.com/Open-LLM-VTuber/Open-LLM-VTuber/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248624767,"owners_count":21135496,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","ai-companion","ai-vtuber","ai-waifu","chatbots","live2d","live2d-web","llm","neuro-sama","ollama"],"created_at":"2025-01-24T15:14:46.771Z","updated_at":"2025-04-12T19:39:53.297Z","avatar_url":"https://github.com/Open-LLM-VTuber.png","language":"Python","funding_links":["https://buymeacoffee.com/yi.ting","https://www.buymeacoffee.com/yi.ting"],"categories":[],"sub_categories":[],"readme":"\n![](./assets/banner.cn.jpg)\n\n\u003ch1 align=\"center\"\u003eOpen-LLM-VTuber\u003c/h1\u003e\n\u003ch3 align=\"center\"\u003e\n\n[![GitHub release](https://img.shields.io/github/v/release/t41372/Open-LLM-VTuber)](https://github.com/t41372/Open-LLM-VTuber/releases)\n[![license](https://img.shields.io/github/license/t41372/Open-LLM-VTuber)](https://github.com/t41372/Open-LLM-VTuber/blob/master/LICENSE)\n[![CodeQL](https://github.com/Open-LLM-VTuber/Open-LLM-VTuber/actions/workflows/codeql.yml/badge.svg)](https://github.com/Open-LLM-VTuber/Open-LLM-VTuber/actions/workflows/codeql.yml)\n[![Ruff](https://github.com/Open-LLM-VTuber/Open-LLM-VTuber/actions/workflows/ruff.yml/badge.svg)](https://github.com/Open-LLM-VTuber/Open-LLM-VTuber/actions/workflows/ruff.yml)\n[![Docker](https://img.shields.io/badge/t41372%2FOpen--LLM--VTuber-%25230db7ed.svg?logo=docker\u0026logoColor=blue\u0026labelColor=white\u0026color=blue)](https://hub.docker.com/r/t41372/open-llm-vtuber) \n[![QQ群](https://img.shields.io/badge/QQ群-792615362-white?style=flat\u0026logo=qq\u0026logoColor=white)](https://qm.qq.com/q/ngvNUQpuKI)\n[![QQ频道](https://img.shields.io/badge/QQ频道(开发)-pd93364606-white?style=flat\u0026logo=qq\u0026logoColor=white)](https://pd.qq.com/s/tt54r3bu)\n\n[![BuyMeACoffee](https://img.shields.io/badge/Buy%20Me%20a%20Coffee-ffdd00?style=for-the-badge\u0026logo=buy-me-a-coffee\u0026logoColor=black)](https://www.buymeacoffee.com/yi.ting)\n[![](https://dcbadge.limes.pink/api/server/3UDA8YFDXx)](https://discord.gg/3UDA8YFDXx)\n\n[英文 README](https://github.com/t41372/Open-LLM-VTuber/blob/main/README.md) | 中文 README\n\n[使用文档](https://open-llm-vtuber.github.io/docs/quick-start) | | [![项目路线图](https://img.shields.io/badge/项目路线图-GitHub_Project-yellow)](https://github.com/orgs/Open-LLM-VTuber/projects/2)\n\n\u003ca href=\"https://trendshift.io/repositories/12358\" target=\"_blank\"\u003e\u003cimg src=\"https://trendshift.io/api/badge/repositories/12358\" alt=\"t41372%2FOpen-LLM-VTuber | Trendshift\" style=\"width: 250px; height: 55px;\" width=\"250\" height=\"55\"/\u003e\u003c/a\u003e\n\n\u003c/h3\u003e\n\n\u003e [常见问题文档](https://docs.qq.com/pdf/DTFZGQXdTUXhIYWRq)\n\u003e\n\u003e [用户调查问卷(英文)](https://forms.gle/w6Y6PiHTZr1nzbtWA)\n\u003e\n\u003e [用户调查问卷(中文)](https://wj.qq.com/s2/16150415/f50a/)\n\n\n\n\u003e :warning: 本项目仍处于早期阶段，目前正在**积极开发中**。\n\n\u003e :warning: 如果你想远程运行服务端并在其他设备上访问 (比如在电脑上运行服务端，在手机上访问)，由于前端的麦克风功能仅能在安全环境下使用（即 https 或 localhost），请参阅 [MDN 文档](https://developer.mozilla.org/en-US/docs/Web/API/MediaDevices/getUserMedia)，你需要配置反向代理和 https 才能在非本机 (non-localhost) 上正常访问。\n\n\n\n# ⭐️ 项目简介\n\n\n**Open-LLM-VTuber** 是一款独特的**语音交互 AI 伴侣**，它不仅支持**实时语音对话**和**视觉感知**，还配备了生动的 **Live2D 形象**。所有功能都可以在你的电脑上完全离线运行！\n\n你可以把它当作你的专属 AI 伴侣 —— 无论你想要一个`虚拟女友`、`男友`、`萌宠`还是其他角色，它都能满足你的期待。项目完美支持 `Windows`、`macOS` 和 `Linux` 系统，并提供两种使用方式：网页版和桌面客户端（特别支持**透明背景的桌宠模式**，让 AI 伴侣在屏幕上的任意位置时刻陪伴着你）。\n\n虽然长期记忆功能暂时下线（即将回归），但得益于聊天记录的持久化存储，你随时都能继续之前未完的对话，不会丢失任何珍贵的互动瞬间。\n\n在后端支持方面，我们集成了丰富多样的 LLM 对话引擎、文本转语音模型和语音识别方案。如果你想让 AI 伴侣更有个性，还可以参考 [角色定制指南](https://open-llm-vtuber.github.io/docs/user-guide/live2d) 来自定义专属的 AI 伴侣形象和人设。\n\n关于为什么叫 `Open-LLM-Vtuber` 而不是 `Open-LLM-Companion` 或者 `Open-LLM-Waifu`，是因为项目的开发初衷是采用可在 Windows 以外平台离线运行的开源方案，复现闭源的 AI Vtuber `neuro-sama`。\n\n本项目在 `v1.0.0` 版本后进行了代码重构，目前正处于积极开发阶段，未来还有许多令人兴奋的功能即将推出！🚀 查看我们的 [Roadmap](https://github.com/users/t41372/projects/1/views/5)，了解更新计划。\n\n\n## 👀 效果演示\n\n| ![](assets/i1.jpg) | ![](assets/i2.jpg) |\n|:---:|:---:|\n| ![](assets/i3.jpg) | ![](assets/i4.jpg) |\n\n\n## ✨ 功能和亮点\n\n- 🖥️ **跨平台支持**：完美支持 macOS、Linux 和 Windows。我们支持英伟达和非英伟达 GPU，可以选择在 CPU 上运行或使用云 API 处理资源密集型任务。部分组件在 macOS 上支持 GPU 加速。\n\n- 🔒 **支持离线模式**：使用本地模型完全离线运行 - 无需联网。你的对话只会待在你的设备上，确保隐私安全。\n\n- 💻 **好看且功能强大的网页和桌面客户端**：提供网页版和桌面客户端两种使用方式，支持丰富的交互功能和个性化设置，桌面客户端还可以在窗口模式和桌宠模式之间自由切换，让 AI 伴侣随时陪伴在身边\n\n- 🎯 **高级交互功能**：\n  - 👁️ 视觉感知，支持摄像头、屏幕录制和截图，让 AI 伙伴能看到你和你的屏幕\n  - 🎤 语音打断，无需耳机（AI 不会听到自己的声音）\n  - 🫱 触摸反馈，可以通过点击或拖拽与 AI 伙伴互动\n  - 😊 Live2D 表情，设置情绪映射让后端控制模型表情\n  - 🐱 宠物模式，支持透明背景全局置顶和鼠标穿透 - 可以将你的 AI 伙伴拖到屏幕上的任意位置\n  - 🗣️ AI 主动说话功能\n  - 💭 AI 内心 OS，AI 的表情、想法和动作可以被看到，但不会被读出来\n  - 💾 聊天记录持久化，可以随时切换到以前的对话\n  - 🌍 TTS 翻译支持（例如，用中文聊天的同时，AI 使用日语声音）\n\n- 🧠 **广泛的模型支持**：\n  - 🤖 大语言模型 (LLM)：Ollama、OpenAI（以及任何与 OpenAI 兼容的 API）、Gemini、Claude、Mistral、DeepSeek、智谱、GGUF、LM Studio、vLLM 等\n  - 🎙️ 语音识别 (ASR)：sherpa-onnx、FunASR、Faster-Whisper、Whisper.cpp、Whisper、Groq Whisper、Azure ASR等\n  - 🔊 语音合成 (TTS)：sherpa-onnx、pyttsx3、MeloTTS、Coqui-TTS、GPTSoVITS、Bark、CosyVoice、Edge TTS、Fish Audio、Azure TTS等\n\n- 🔧 **高度可定制**:\n  - ⚙️ **简单的模块配置**：通过简单的配置文件修改，即可切换各种功能模块，无需深入代码\n  - 🎨 **角色随心定制**：导入自定义 Live2D 模型，让你的 AI 伴侣拥有独特外观。通过修改 Prompt，塑造你 AI 伴侣的人设。进行音色克隆，让你的 AI 伴侣有着你想要的声线\n  - 🧩 **Agent自由实现**：继承并实现 Agent 接口，接入任何架构的 Agent，如 HumeAI EVI、OpenAI Her、Mem0 等\n  - 🔌 **良好的可扩展性**：模块化设计让你能轻松添加自己的 LLM、ASR、TTS 等模块实现，随时扩展新特性\n\n\n## 👥 用户评价\n\u003e 感谢开发者把女朋友开源分享出来让大家一起使用\n\u003e \n\u003e 该女友使用次数已达 10w+\n\n## 🚀 快速上手\n\n请阅读 [快速上手](https://open-llm-vtuber.github.io/docs/quick-start) 文档以安装项目。\n\n\n\n## ☝ 更新\n\u003e :warning: `v1.0.0` 版本有重大变更，需要重新部署。你*仍然可以*通过以下方法更新，但 `conf.yaml` 文件不兼容，并且大多数依赖项需要使用 `uv` 重新安装。如果你是准备从`v1.0.0`之前的版本升级到 `v1.0.0` 或之后的版本，建议按照[最新的部署指南](https://open-llm-vtuber.github.io/docs/quick-start)重新部署本项目。\n\n如果你使用的是 `v1.0.0` 之后的版本，请运行更新脚本 `uv run upgrade.py` 进行更新。\n\n## 😢 卸载\n大多数文件，包括Python依赖和模型，都存储在项目文件夹中，所以删除项目文件夹就十分足够了。\n\n然而，通过ModelScope或Hugging Face下载的模型可能也存在于`MODELSCOPE_CACHE`或`HF_HOME`中。虽然我们尽量将它们保存在项目的`models`目录中，但再次检查也无妨。\n\n查看安装指南中，你所安装但可能不再需要的任何额外工具，例如`uv`、`ffmpeg`或`deeplx`。\n\n## 🤗 想为项目做贡献?\n可以看看 [开发指南](https://docs.llmvtuber.com/docs/development-guide/overview).\n\n# 🎉🎉🎉 相关项目\n\n[ylxmf2005/LLM-Live2D-Desktop-Assitant](https://github.com/ylxmf2005/LLM-Live2D-Desktop-Assitant)\n- 你的 Live2D 桌面助手，由大语言模型 (LLM) 驱动！支持 Windows 和 macOS，它可以感知你的屏幕，检索剪贴板内容，并用独特的声音响应语音命令。具有语音唤醒、歌唱功能和完整的电脑控制，与你最喜欢的角色无缝交互。\n\n\n## 📜 第三方许可证\n\n### Live2D 样本模型声明\n\n本项目包含由 Live2D Inc. 提供的 Live2D 样本模型。这些资产根据 Live2D 免费素材许可协议和 Live2D Cubism 样本数据使用条款单独授权，不受本项目 MIT 许可证的约束。\n\n本内容使用由 Live2D Inc. 拥有并享有版权的样本数据。样本数据的使用符合 Live2D Inc. 制定的条款和条件。（参见 [Live2D 免费素材许可协议](https://www.live2d.jp/en/terms/live2d-free-material-license-agreement/) 和 [使用条款](https://www.live2d.com/eula/live2d-sample-model-terms_en.html)）。\n\n注意：对于商业用途，特别是对于中型或大型企业，使用这些 Live2D 样本模型可能需要额外的许可要求。如果您计划将本项目用于商业目的，请确保您已获得 Live2D Inc. 的适当许可，或使用不包含这些模型的项目版本。\n\n\n## Star 历史\n\n[![Star History Chart](https://api.star-history.com/svg?repos=t41372/open-llm-vtuber\u0026type=Date)](https://star-history.com/#t41372/open-llm-vtuber\u0026Date)\n---\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopen-llm-vtuber%2Fopen-llm-vtuber","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopen-llm-vtuber%2Fopen-llm-vtuber","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopen-llm-vtuber%2Fopen-llm-vtuber/lists"}