{"id":29371706,"url":"https://github.com/hardcodedev777/unityneurospeech","last_synced_at":"2026-01-21T21:06:48.807Z","repository":{"id":303229077,"uuid":"1014305792","full_name":"HardCodeDev777/UnityNeuroSpeech","owner":"HardCodeDev777","description":"The world’s first game framework that lets you talk to AI in real time — locally.","archived":false,"fork":false,"pushed_at":"2025-07-06T12:57:12.000Z","size":719,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-07-06T13:45:31.904Z","etag":null,"topics":["ai","coqui-tts","csharp","framework","llm","ollama","speech-to-text","stt","text-to-speech","tts","unity","unity-framework","unityneurospeech","whisper"],"latest_commit_sha":null,"homepage":"https://hardcodedev777.github.io/UnityNeuroSpeech/","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/HardCodeDev777.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-07-05T13:03:23.000Z","updated_at":"2025-07-06T13:10:43.000Z","dependencies_parsed_at":"2025-07-06T13:45:36.173Z","dependency_job_id":"a91549c7-e1d7-4561-b25f-9d298b842f5d","html_url":"https://github.com/HardCodeDev777/UnityNeuroSpeech","commit_stats":null,"previous_names":["hardcodedev777/unityneurospeech"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/HardCodeDev777/UnityNeuroSpeech","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HardCodeDev777%2FUnityNeuroSpeech","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HardCodeDev777%2FUnityNeuroSpeech/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HardCodeDev777%2FUnityNeuroSpeech/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HardCodeDev777%2FUnityNeuroSpeech/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/HardCodeDev777","download_url":"https://codeload.github.com/HardCodeDev777/UnityNeuroSpeech/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/HardCodeDev777%2FUnityNeuroSpeech/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264492282,"owners_count":23617025,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","coqui-tts","csharp","framework","llm","ollama","speech-to-text","stt","text-to-speech","tts","unity","unity-framework","unityneurospeech","whisper"],"created_at":"2025-07-09T16:00:55.129Z","updated_at":"2026-01-21T21:06:48.793Z","avatar_url":"https://github.com/HardCodeDev777.png","language":"C#","readme":"![Unity](https://img.shields.io/badge/Unity-unity?logo=Unity\u0026color=%23000000)\n\u0026nbsp;\n\n![License](https://img.shields.io/github/license/HardCodeDev777/UnityNeuroSpeech?color=%2305991d)\n![Last commit](https://img.shields.io/github/last-commit/HardCodeDev777/UnityNeuroSpeech?color=%2305991d)\n![Tag](https://img.shields.io/github/v/tag/HardCodeDev777/UnityNeuroSpeech)\n![Top lang](https://img.shields.io/github/languages/top/HardCodeDev777/UnityNeuroSpeech)\n![quality](https://img.shields.io/badge/quality-best-brightgreen)\n![code_style](https://img.shields.io/badge/code_style-goat-lightgrey)\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"docs/media/logo.png\"\u003e\n\u003c/div\u003e\n\n#\n\n\u003e **Make your Unity characters hear, think, and talk — using real voice AI. Locally. No cloud.**\n\n---\n\nUnityNeuroSpeech is an open-source framework for creating **fully voice-interactive AI agents** inside Unity.  \nIt connects:\n\n- 🧠 **Whisper** (STT) – converts your speech into text  \n- 💬 **Ollama** (LLM) – generates smart responses  \n- 🗣️ **XTTS** (TTS) – speaks back with *custom voice + emotions*\n\nAll locally. All offline.  \nNo subscriptions, no accounts, no OpenAI API keys.\n\n---\n\n## 🚀 What can you build with UnityNeuroSpeech?\n\n- 🎮 AI characters that understand your voice and reply in real time  \n- 🗿 NPCs with personality and memory  \n- 🧪 Experiments in AI conversation and narrative design  \n- 🕹️ Voice-driven gameplay mechanics  \n- 🤖 Interactive bots with humanlike voice responses\n\n---\n\n## ✨ Core Features\n\n| Feature | Description                                                                                |\n|--------|--------------------------------------------------------------------------------------------|\n| 🎙️ **Voice Input** | Uses [whisper.unity](https://github.com/Macoron/whisper.unity) for accurate speech-to-text |\n| 🧠 **AI Brain (LLM)** | Easily connect to any local model via [Ollama](https://ollama.com)                         |\n| 🗣️ **Custom TTS** | Supports any voice with [Coqui XTTS](https://github.com/idiap/coqui-ai-TTS)                      |\n| 😄 **Emotions** | Emotion tags (`\u003chappy\u003e`, `\u003csad\u003e`, etc.) parsed automatically from LLM                      |\n| 🎬 **Actions** | Action tags (`\u003cturn_off_lights\u003e`, `\u003cplay_cutscene_123\u003e`, etc.) also parsed automatically from LLM                      |\n| 🎛️ **Agent API** | Subscribe to events like `BeforeTTS()` to monitor your agents                  |\n| 📝 **History Saving in JSON** | Save dialog history between player and LLM in JSON with/without AES encryption                 |\n| 🛠️ **Editor Tools** | Create, manage and customize agents inside Unity Editor easily                                  |\n| 🧱 **No Cloud** | All models and voice run locally on your machine                                           |\n| 🌐 **Multilingual** | Works with over **15+ languages**, including English, Russian, Chinese, etc.               |\n| 🔊 **Multiple Voices and Languages for Multiple Agents** | Each Agent can have each voice file for any available laguage              |\n| ⚡ **High Performance** | Uses **UniTask** instead of Coroutines and Tasks for optimal performance.             |\n| 🔧 **Full Build Support** | Full compatibility with both **Mono** and **IL2CPP** scripting backends.           |\n\n\n---\n\n## 🧪 Built with:\n\n- 🧠 [OllamaSharp](https://github.com/awaescher/OllamaSharp) \n- 🎤 [whisper.unity](https://github.com/Macoron/whisper.unity)\n- ⚡ [UniTask](https://github.com/Cysharp/UniTask)\n- 🧊 [Coqui XTTS](https://github.com/idiap/coqui-ai-TTS)\n- 🖥️ [UV](https://github.com/astral-sh/uv)\n- 🤖 Unity 6\n\n---\n\n## ⚙️ Compatibility\n\n| Scripting backend | Windows |  Other platforms    |\n|-------------------|---------|--------------------|\n| Mono              | ✅       | ❌ (not planned)    |\n| IL2CPP            | ✅       | ❌ (not planned)    |\n\n---\n\n## 📚 Getting Started\n\nSee [UnityNeuroSpeech official documentation](https://hardcodedev777.github.io/UnityNeuroSpeech/).\n\n---\n\n## 😎 Who made this?\n\nUnityNeuroSpeech was created by [HardCodeDev](https://github.com/HardCodeDev777) —  solo dev from Russia.\n\n---\n\n## 🗒️ License\n\nUnityNeuroSpeech is licensed under the **MIT License**.\nFor other Licenses, see [Licenses](LICENSES.md).\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhardcodedev777%2Funityneurospeech","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhardcodedev777%2Funityneurospeech","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhardcodedev777%2Funityneurospeech/lists"}