{"id":51516720,"url":"https://github.com/timoncool/dub-studio","last_synced_at":"2026-07-08T12:30:25.879Z","repository":{"id":366446703,"uuid":"1276296530","full_name":"timoncool/dub-studio","owner":"timoncool","description":"The open-source CapCut for AI dubbing — dub any short video into 6 languages, 100% local, with a live editor.","archived":false,"fork":false,"pushed_at":"2026-07-07T12:41:41.000Z","size":33897,"stargazers_count":34,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"master","last_synced_at":"2026-07-07T14:15:40.452Z","etag":null,"topics":["ai-dubbing","asr","dubbing","fastapi","local-first","portable","react","subtitles","translation","tts","video"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/timoncool.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null},"funding":{"custom":["https://github.com/timoncool/dub-studio/blob/master/DONATE.md","https://dalink.to/nerual_dreming","https://boosty.to/neuro_art"]}},"created_at":"2026-06-21T19:50:59.000Z","updated_at":"2026-07-07T12:41:47.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/timoncool/dub-studio","commit_stats":null,"previous_names":["timoncool/dub-studio"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/timoncool/dub-studio","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timoncool%2Fdub-studio","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timoncool%2Fdub-studio/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timoncool%2Fdub-studio/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timoncool%2Fdub-studio/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/timoncool","download_url":"https://codeload.github.com/timoncool/dub-studio/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/timoncool%2Fdub-studio/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":35265380,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-07-08T02:00:06.796Z","response_time":61,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai-dubbing","asr","dubbing","fastapi","local-first","portable","react","subtitles","translation","tts","video"],"created_at":"2026-07-08T12:30:24.929Z","updated_at":"2026-07-08T12:30:25.872Z","avatar_url":"https://github.com/timoncool.png","language":"Python","funding_links":["https://github.com/timoncool/dub-studio/blob/master/DONATE.md","https://dalink.to/nerual_dreming","https://boosty.to/neuro_art"],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003cimg src=\"frontend/public/favicon.svg\" width=\"72\" alt=\"Dub Studio\"/\u003e\n\n# Dub Studio\n\n**The open-source CapCut for AI dubbing** — dub any short video into 6 languages, **locally \u0026 free**, with a live editor.\n\n[![Stars](https://img.shields.io/github/stars/timoncool/dub-studio?style=social)](https://github.com/timoncool/dub-studio/stargazers)\n[![License](https://img.shields.io/github/license/timoncool/dub-studio)](LICENSE)\n[![Release](https://img.shields.io/github/v/release/timoncool/dub-studio?include_prereleases)](https://github.com/timoncool/dub-studio/releases)\n![Status: beta · help wanted](https://img.shields.io/badge/status-beta%20%C2%B7%20help%20wanted-f59e0b?labelColor=0b0c0e)\n![Windows portable](https://img.shields.io/badge/Windows-portable-0b0c0e?logo=windows)\n![100% local](https://img.shields.io/badge/100%25-local%20%C2%B7%20no%20upload-c6f24e?labelColor=0b0c0e)\n\nSmart auto‑defaults do the first pass; then you override **every caption, voice, blur box, font \u0026 title** with instant preview. Runs on your own GPU. No subscription, no uploads.\n\n\u003csub\u003e**[Releases](https://github.com/timoncool/dub-studio/releases)** · **[Packaging](PACKAGING.md)** · dubs into EN / RU / ZH / ES / PT / FR\u003c/sub\u003e\n\n**English** · **[Русский](README_RU.md)**\n\n\u003cimg src=\"docs/screenshot.png\" width=\"900\" alt=\"Dub Studio live editor — side-by-side original ↔ dubbed compare, transcript lane, and the title/subtitle style panel\"/\u003e\n\n\u003c/div\u003e\n\n---\n\n\u003e [!IMPORTANT]\n\u003e **Dub Studio is beta — and it's 100% not perfect yet.** Many features still need polish, and you can\n\u003e help shape where it goes. The big one on the roadmap: making **every module swappable — ASR, LLM,\n\u003e vision, TTS** — so you can plug in any model and tune the whole pipeline however you like. It's a large\n\u003e effort and I'd love your help: issues, PRs, testing on real clips, and model recipes all move it forward.\n\u003e If it's useful, ⭐ the repo and jump in.\n\n## Why\n\nCloud dubbing tools (HeyGen, Rask, ElevenLabs) charge per minute, upload your footage and your\nvoiceprint, and give you shallow editing. Open‑source CLI tools are powerful but Gradio‑grade — no\ndraggable canvas, no live preview. **Dub Studio is the missing middle:** a premium live‑preview\neditor, the only one that also **detects, blurs and re‑captions on‑screen text**, fully local and free.\n\n## Examples\n\nRussian original (left) → dubbed into English by Dub Studio (right) — voice **and** on‑screen text:\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd align=\"center\"\u003e\u003cb\u003eOriginal — RU\u003c/b\u003e\u003c/td\u003e\n\u003ctd align=\"center\"\u003e\u003cb\u003eDubbed to English\u003c/b\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\u003cvideo src=\"https://github.com/user-attachments/assets/f1e1046f-7f65-445e-ae15-cd6cc6cf2db2\" controls\u003e\u003c/video\u003e\u003c/td\u003e\n\u003ctd\u003e\u003cvideo src=\"https://github.com/user-attachments/assets/a7a72493-0e25-4d37-acc1-e28998355cfe\" controls\u003e\u003c/video\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n\n\n\n\n\n\n\n\n## Features\n\n| | |\n|---|---|\n| 🎙️ **Faithful dub** | clone the original timbre, auto‑cast per speaker by gender, or pick a pack voice — different voice per speaker |\n| 🌍 **6 languages** | translate speech *and* on‑screen text; auto‑detects the source language |\n| 🅰️ **On‑screen text** | OCR → blur the original → re‑caption localized, in the matched style (the wedge no other tool owns) |\n| 🎬 **Live editor** | edit transcript, voices, caption style, blur boxes, titles — frame‑accurate preview at every step |\n| 🎛️ **Caption presets** | 26 built‑in looks (karaoke / word‑by‑word / hormozi / neon / …) rendered on *your* frame |\n| 😂 **Funny remix** | give a theme (\"pirate\", \"as a news report\") → the model rewrites the whole script → re‑dub |\n| 🔁 **Before / after** | side‑by‑side original ↔ dubbed — the trust check |\n\n## Dub Studio vs the alternatives\n\n| | Dub Studio | OSS CLI tools | HeyGen / Rask / ElevenLabs |\n|---|:--:|:--:|:--:|\n| Local \u0026 private (no upload) | ✅ | ✅ | ❌ |\n| Free | ✅ | ✅ | ❌ |\n| Live‑preview editor | ✅ | ❌ | ⚠️ shallow |\n| On‑screen text blur + re‑caption | ✅ | ❌ | ⚠️ few, cloud |\n| Portable (one folder) | ✅ | ⚠️ | — |\n\n## Install\n\n\u003e 🚀 **One-click, cross-platform install via [Pinokio](https://pinokio.co)** — Windows / Linux / macOS · NVIDIA / AMD / CPU:\n\u003e\n\u003e [![Install on Pinokio](https://img.shields.io/badge/🚀_Install_on-Pinokio-7c3aed?style=for-the-badge)](https://pinokio.co/item?uri=https://github.com/timoncool/dub-studio-pinokio) [![Open in Pinokio](https://img.shields.io/badge/📂_Open_in-Pinokio-6d28d9?style=for-the-badge)](https://beta.pinokio.co/apps/github-com-timoncool-dub-studio-pinokio)\n\u003e\n\u003e No `install.bat`, no manual CUDA wheels — Pinokio installs the right stack for your machine and the engine falls back gracefully off-NVIDIA. Launcher repo: **[timoncool/dub-studio-pinokio](https://github.com/timoncool/dub-studio-pinokio)**.\n\n### Windows portable (manual)\n\n**You need:** [Git](https://git-scm.com/download/win) · an NVIDIA GPU (RTX 20xx–50xx, CUDA 12.8, ~12 GB VRAM) · several GB of free disk for the wheels and models. You do **not** need Python, CUDA, Node or ffmpeg pre-installed — the installer fetches them all into the app folder, nothing system-wide.\n\n**1 — Clone the repo**\n\n```bash\ngit clone https://github.com/timoncool/dub-studio.git\ncd dub-studio\n```\n\n**2 — Install:** double-click **`install.bat`** (or run it from the folder). One-time setup, entirely inside the folder — it installs:\n\n- embeddable **Python 3.11** + pip\n- **PyTorch 2.8** (CUDA 12.8) + the engine requirements\n- **llama-cpp-python** (Gemma GGUF, cu128) + **Triton** kernels\n- the **`dub-engine`** package (editable install)\n- **ffmpeg** (NVENC) + **Node**, then builds the web UI\n- the base **voice pack**\n- *optional:* a NeMo sub-venv for multi-speaker diarization (skips cleanly if it can't build)\n\n**3 — Run:** double-click **`run.bat`**. It launches the local server and opens the editor at **http://127.0.0.1:8765**. Drop a video → the AI models (Gemma‑4 GGUF + mmproj, Parakeet, Qwen3‑TTS, Sortformer) download on first use, then it dubs. Close the window to stop.\n\n\u003e **Shortcut:** you can skip step 2 — on a fresh clone, **`run.bat`** auto-runs `install.bat` for you if the app isn't set up yet. Minimum path: clone → double-click `run.bat`.\n\n**Updating:** `git pull`, then double-click **`update.bat`** (re-pulls, reinstalls the engine, rebuilds the UI).\n\n| Script | What it does |\n|---|---|\n| **`install.bat`** | one-time setup — Python, CUDA wheels, engine, llama-cpp/Triton, ffmpeg, Node, UI build, voice pack |\n| **`run.bat`** | start the app at `http://127.0.0.1:8765` (auto-runs `install.bat` on first launch) |\n| **`update.bat`** | `git pull` → reinstall the engine → rebuild the UI |\n\n## How it works\n\n`analyze()` is the fixed first stage: separate → ASR (word timings) → diarize → context‑translate +\nvision (caption style / titles / brands) → OCR (layout / blur boxes). It returns an editable\n**Project** document. Every edit is a patch on that Project with a ~0.14 s CPU preview; export re‑runs\nonly the dirtied stages. The engine is a self‑contained package in this repo under `dub-engine/`, bundled into the portable build.\n\n**Stack:** React 19 + Vite + Tailwind + react‑konva over JASSUB · single‑worker FastAPI · Parakeet\nTDT (ASR) · Sortformer (diarization) · Gemma‑4‑12B GGUF (translate + vision) · Qwen3‑TTS · ffmpeg/NVENC.\n\n## Contributing\n\n**Dub Studio is beta and built in the open — your help is genuinely wanted.** Issues, PRs, testing on real\nclips, and model recipes are all welcome; good‑first‑issues are labeled, and I aim to respond within 24 h.\n\n**On the roadmap — great places to jump in:**\n\n- **Swappable modules** — make ASR / LLM / vision / TTS fully pluggable, so anyone can wire in their own\n  model and configure the whole pipeline end‑to‑end. This is the big one.\n- Smarter on‑screen‑text localization — colour / contrast matching on tricky backgrounds.\n- More voice packs, caption presets, and target languages.\n\nIf any of this is your thing, open an issue to claim it — I'm happy to help you get set up.\n\n## License\n\nThe app is open‑source; bundled models keep their own licenses (audited before each release).\n\n---\n\n## More portable neural nets by the author\n\n| Project | What it does |\n|---|---|\n| [Foundation Music Lab](https://github.com/timoncool/Foundation-Music-Lab) | Music generation + timeline editor |\n| [VibeVoice ASR](https://github.com/timoncool/VibeVoice_ASR_portable_ru) | Speech recognition (ASR) |\n| [LavaSR](https://github.com/timoncool/LavaSR_portable_ru) | Audio super‑resolution |\n| [Qwen3‑TTS](https://github.com/timoncool/Qwen3-TTS_portable_rus) | Text‑to‑speech (Qwen) |\n| [SuperCaption Qwen3‑VL](https://github.com/timoncool/SuperCaption_Qwen3-VL) | Image captioning |\n| [VideoSOS](https://github.com/timoncool/videosos) | In‑browser AI video production |\n| [RC Stable Audio Tools](https://github.com/timoncool/RC-stable-audio-tools-portable) | Music \u0026 audio generation |\n\n## Author\n\n- **Nerual Dreming** ([t.me/nerual_dreming](https://t.me/nerual_dreming)) — [neuro-cartel.com](https://neuro-cartel.com) · founder of [ArtGeneration.me](https://artgeneration.me)\n- **Neuro‑Soft** ([t.me/neuroport](https://t.me/neuroport)) — portable repacks of neural nets\n\n---\n\n\u003e **If this is useful, drop a ⭐ — it helps others find the project and keeps it moving.**\n\n## Support the Author\n\nI build open-source software and do AI research. Most of what I create is free and available to everyone. Your donations help me keep creating without worrying about where the next meal comes from =)\n\n**[All donation methods](DONATE.md)** | **[dalink.to/nerual_dreming](https://dalink.to/nerual_dreming)** | **[boosty.to/neuro_art](https://boosty.to/neuro_art)**\n\n- **BTC:** `1E7dHL22RpyhJGVpcvKdbyZgksSYkYeEBC`\n- **ETH (ERC20):** `0xb5db65adf478983186d4897ba92fe2c25c594a0c`\n- **USDT (TRC20):** `TQST9Lp2TjK6FiVkn4fwfGUee7NmkxEE7C`\n\n## Star History\n\n\u003ca href=\"https://github.com/timoncool/dub-studio/stargazers\"\u003e\n \u003cpicture\u003e\n   \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"docs/stars-dark.svg\" /\u003e\n   \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"docs/stars-light.svg\" /\u003e\n   \u003cimg alt=\"Star History Chart\" src=\"docs/stars-light.svg\" /\u003e\n \u003c/picture\u003e\n\u003c/a\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftimoncool%2Fdub-studio","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftimoncool%2Fdub-studio","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftimoncool%2Fdub-studio/lists"}