https://github.com/TheDeathDragon/LiveTranslate
Real-time audio translation, captures system audio + mic, runs ASR (Whisper/SenseVoice), translates via LLM API with streaming display. Perfect for VTubers, livestreamers, and watching foreign content. Windows 实时音频翻译，ASR 语音识别后 LLM 流式翻译显示，适合 VTuber、主播和外语视频观看。
https://github.com/TheDeathDragon/LiveTranslate
asr funasr live-translation real-time-translation speech-recognition subtitle-overlay voice-recognition vtuber vtuber-software vuter-subtitle
Last synced: 2 days ago
JSON representation
Real-time audio translation, captures system audio + mic, runs ASR (Whisper/SenseVoice), translates via LLM API with streaming display. Perfect for VTubers, livestreamers, and watching foreign content. Windows 实时音频翻译，ASR 语音识别后 LLM 流式翻译显示，适合 VTuber、主播和外语视频观看。
- Host: GitHub
- URL: https://github.com/TheDeathDragon/LiveTranslate
- Owner: TheDeathDragon
- License: mit
- Created: 2026-03-15T11:10:24.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2026-07-09T16:18:58.000Z (4 days ago)
- Last Synced: 2026-07-09T18:12:02.412Z (4 days ago)
- Topics: asr, funasr, live-translation, real-time-translation, speech-recognition, subtitle-overlay, voice-recognition, vtuber, vtuber-software, vuter-subtitle
- Language: Python
- Homepage:
- Size: 6.13 MB
- Stars: 420
- Watchers: 0
- Forks: 37
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-ai-media - LiveTranslate - square) | ⭐ B | Windows real-time audio translation overlay for videos, livestreams, and voice chat, with faster-whisper / SenseVoice ASR, OpenAI-compatible translation APIs, and streaming subtitle display. | (Subtitle and Localization)
README
# LiveTranslate
**English** | [中文](README_zh.md)
Real-time audio translation for Windows. Captures system audio (WASAPI loopback) and optional microphone input, runs ASR, translates via LLM API, and displays results in a transparent overlay.
Works with any system audio — videos, livestreams, voice chat. No player modifications needed.
## Screenshot
## Video
[](https://www.bilibili.com/video/BV1K2Awz6Euw)
## Features
- **Real-time pipeline**: System audio → VAD → ASR → LLM translation → overlay
- **Multiple ASR engines**: faster-whisper, SenseVoice, FunASR Nano, Anime-Whisper
- **Remote ASR**: offload speech recognition to a GPU machine over HTTP — see [REMOTE_ASR.md](REMOTE_ASR.md)
- **Any OpenAI-compatible API**: DeepSeek, Grok, Qwen, GPT, Ollama, vLLM, etc.
- **Streaming translation display**: Real-time character-by-character translation output
- **Per-model settings**: Streaming, structured output (JSON), context history, disable thinking
- **Microphone mix-in**: Optionally mix microphone input with system audio for ASR
- **Low-latency VAD**: 32ms chunks + Silero VAD with adaptive silence detection
- **Transparent overlay**: Always-on-top, click-through, draggable, 14 color themes
- **CUDA acceleration**: GPU-accelerated ASR inference
- **Auto model management**: Setup wizard, ModelScope / HuggingFace dual sources
- **Built-in benchmark**: Compare translation model speed and quality
## Changelog
See [English Changelog](i18n/CHANGELOG_en.md) | [中文更新日志](i18n/CHANGELOG_zh.md)
## Requirements
- **OS**: Windows 10/11
- **Python**: 3.10–3.12 (or use the portable build)
- **GPU** (recommended): NVIDIA + CUDA 12.6 (Blackwell GPUs like RTX 50xx require CUDA 12.8)
- **Network**: Access to a translation API
## Quick Start
### Portable build (no Python required, recommended for non-developers)
Download `LiveTranslate-portable-*.zip` from [Releases](https://github.com/TheDeathDragon/LiveTranslate/releases), unzip, and double-click **`start.bat`**. The first run auto-downloads a portable Python 3.12 and installs GPU-aware dependencies — no Python installation needed.
### From source
```bash
git clone https://github.com/TheDeathDragon/LiveTranslate.git
cd LiveTranslate
```
Double-click **`install.bat`** — the installer will:
1. Detect Python 3.10–3.12 (auto-install via winget if missing)
2. Create a virtual environment
3. Auto-detect NVIDIA GPU and let you choose CUDA / CPU PyTorch
4. Install all dependencies
Then double-click **`start.bat`** to launch.
To update, double-click **`update.bat`** — it will pull the latest code and update dependencies (auto-installs Git via winget if missing).
Manual install
```bash
python -m venv .venv
.venv\Scripts\activate
# PyTorch (choose one)
pip install torch torchaudio --index-url https://download.pytorch.org/whl/cu126 # CUDA
pip install torch torchaudio --index-url https://download.pytorch.org/whl/cu128 # CUDA (RTX 50xx)
pip install torch torchaudio --index-url https://download.pytorch.org/whl/cpu # CPU only
# Dependencies
pip install -r requirements.txt
pip install funasr --no-deps
# Launch
.venv\Scripts\python.exe main.py
```
> FunASR uses `--no-deps` because `editdistance` requires a C++ compiler. `editdistance-s` in `requirements.txt` is a pure-Python drop-in replacement.
## First Launch
1. Setup wizard appears — choose download source (ModelScope / HuggingFace) and cache path
2. Silero VAD + SenseVoice models download automatically (~1GB)
3. Main UI appears when ready
## Translation API
Settings → Translation tab:
| Parameter | Example |
|-----------|---------|
| API Base | `https://api.deepseek.com/v1` |
| API Key | Your key |
| Model | `deepseek-chat` |
| Proxy | `none` / `system` / custom URL |
## Architecture
```
Audio (WASAPI 32ms) → VAD (Silero) → ASR → LLM Translation → Overlay
↑ optional mic mix-in
```
```
main.py Entry point & pipeline
├── audio_capture.py WASAPI loopback + mic mix-in
├── vad_processor.py Silero VAD
├── asr_engine.py faster-whisper backend
├── asr_funasr.py Unified FunASR model selector backend
├── asr_sensevoice.py SenseVoice backend
├── asr_funasr_nano.py FunASR Nano backend
├── asr_anime_whisper.py Anime-Whisper backend (ja anime/galgame)
├── asr_remote.py Remote Whisper client (→ asr_server.py, see REMOTE_ASR.md)
├── translator.py OpenAI-compatible client (streaming, JSON schema, context)
├── model_manager.py Model download & cache
├── subtitle_overlay.py PyQt6 overlay
├── control_panel.py Settings UI (7 tabs)
├── dialogs.py Wizard, download & model config dialogs
└── benchmark.py Translation benchmark
```
## Acknowledgements
- [faster-whisper](https://github.com/SYSTRAN/faster-whisper) — Whisper inference via CTranslate2
- [FunASR](https://github.com/modelscope/FunASR) — SenseVoice / Fun-ASR-Nano
- [Anime-Whisper](https://huggingface.co/litagin/anime-whisper) — Japanese anime/galgame ASR
- [Silero VAD](https://github.com/snakers4/silero-vad) — Voice activity detection
## Star History
## License
[MIT License](LICENSE)