Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/pluja/whishper

Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!
https://github.com/pluja/whishper

ai audio-to-text golang speech-recognition speech-to-text stt subtitles sveltekit transcription ui web web-whisper webapp whisper

Last synced: 5 days ago
JSON representation

Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!

Host: GitHub
URL: https://github.com/pluja/whishper
Owner: pluja
License: agpl-3.0
Created: 2023-08-26T08:34:13.000Z (over 1 year ago)
Default Branch: main
Last Pushed: 2024-09-17T20:19:24.000Z (4 months ago)
Last Synced: 2025-01-09T14:22:00.499Z (12 days ago)
Topics: ai, audio-to-text, golang, speech-recognition, speech-to-text, stt, subtitles, sveltekit, transcription, ui, web, web-whisper, webapp, whisper
Language: Svelte
Homepage: https://whishper.net
Size: 14.1 MB
Stars: 1,794
Watchers: 34
Forks: 99
Open Issues: 68
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Funding: .github/FUNDING.yml
- License: LICENSE

Awesome Lists containing this project

README

        [![whishper banner](misc/banner.png)](https://whishper.net)

[![](https://img.shields.io/badge/website-066da5?style=for-the-badge&logo=icloud&logoColor=white)](https://whishper.net)

[![](https://img.shields.io/badge/self%20host%20guide-066da5?style=for-the-badge&logo=googledocs&logoColor=white)](https://whishper.net/guides/install)

[![](https://img.shields.io/badge/screenshots-5c1f87?style=for-the-badge&logo=slickpic&logoColor=white)](#screenshots)

[![](https://img.shields.io/docker/pulls/pluja/whishper?style=for-the-badge&logo=docker&logoColor=white)](https://hub.docker.com/r/pluja/whishper)

## 🚧 I am working on a complete rewrite of the project. Progress on this can be seen at [v4 branch](https://github.com/pluja/whishper/tree/v4). Consequently, this branch will not receive any new releases or updates.

**Whishper** is an open-source, 100% local audio transcription and subtitling suite with a full-featured web UI.

## Features

- [x] 🗣️ **Transcribe any media** to text: audio, video, etc.

  - Transcribe from URLs (any source supported by yt-dlp).

  - Upload a file to transcribe.

- [x] 📥 **Download transcriptions in many formats**: TXT, JSON, VTT, SRT or copy the raw text to your clipboard.

- [x] 🌐 **Translate your transcriptions** to any language supported by [Libretranslate](https://libretranslate.com).

- [x] ✍️ **Powerful subtitle editor** so you don't need to leave the UI!

  - Transcription highlighting based on media position.

  - CPS (Characters per second) warnings.

  - Segment splitting.

  - Segment insertion.

  - Subtitle language selection.

- [x] 🏠 **100% Local**: transcription, translation and subtitle edition happen 100% on your machine (can even work offline!).

- [x] 🚀 **Fast**: uses FasterWhisper as the Whisper backend: get much faster transcription times on CPU!

- [x] 👍 **Quick and easy setup**: use the quick start script, or run through a few steps!

- [x] 🔥 **GPU support**: use your NVIDIA GPU to get even faster transcription times!

- [x] 🐎 **CPU support**: no GPU? No problem! Whishper can run on CPU too.

### Roadmap

- [ ] Local folder as media input ([#15](https://github.com/pluja/whishper/issues/15)).

- [ ] Full-text search all transcriptions.

- [ ] User authentication.

- [ ] Audio recording from the browser.

- [ ] Add [insanely-fast-whisper](https://github.com/Vaibhavs10/insanely-fast-whisper) as an optional backend ([#53](https://github.com/pluja/whishper/issues/53)).

- [x] ~~Support for GPU acceleration.~~

  - [ ] Non NVIDIA GPU support. Is it possible with faster-whisper?

- [ ] Can we do something with [seamless_communication](https://github.com/facebookresearch/seamless_communication)?

## Project structure

Whishper is a collection of pieces that work together. The three main pieces are:

- Transcription-API: This is the API that enables running Faster-Whisper. You can find it in the `transcription-api` folder.

- Whishper-Backend: This is the backend that coordinates frontend calls, database, and tasks. You can find it in `backend` folder.

- Whishper-Frontend: This is the frontend (web UI) of the application. You can find it in `frontend` folder.

- Translation (3rd party): This is the libretranslate container that is used for translating subtitles.

- MongoDB (3rd party): This is the database that stores all the information about your transcriptions.

- Nginx (3rd party): This is the proxy that allows running everything from a single domain.

### Contributing

Contributions are welcome! Feel free to open a PR with your changes, or take a look at the issues to see if there is something you can help with.

### Development setup

Check out the development documentation [here](https://whishper.net/guides/develop/).

## Screenshots

These screenshots are available on [the official website](https://whishper.net/usage/transcriptions/), click any of the following links to see:

- [A transcription creation](https://whishper.net/usage/transcriptions/)

- [A transcription translation](https://whishper.net/usage/translate/)

- [A transcription download](https://whishper.net/usage/download/)

- [The subtitle editor](https://whishper.net/usage/editor/)

## Support

- [Monero](https://www.getmonero.org/): `82x6cn628oTUXV63DxBd6MJB8d997FhaSaGFvoWMgwihVmgiXYQPAwm2BCH31AovA9Qnnv1qQRrJk83TaJ8DaSZU2zkbWfM`

- [Bitcoin](https://bitcoin.org/en/): `bc1qfph44jl4cy03stwfkk7g0qlwx2grldr9xpk086`

- [Lightning Network (kycnotme)](https://getalby.com/p/kycnotme)

## Star History



  

    

    

    

  



## Credits

- [Faster Whisper](https://github.com/guillaumekln/faster-whisper)

- [LibreTranslate](https://github.com/LibreTranslate/LibreTranslate)