Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/vaibhavs10/optimise-my-whisper
https://github.com/vaibhavs10/optimise-my-whisper
Last synced: 17 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/vaibhavs10/optimise-my-whisper
- Owner: Vaibhavs10
- License: apache-2.0
- Created: 2024-05-23T13:01:46.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-05-27T17:47:59.000Z (7 months ago)
- Last Synced: 2024-05-28T02:56:24.183Z (7 months ago)
- Language: Jupyter Notebook
- Size: 762 KB
- Stars: 42
- Watchers: 5
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# optimise-my-whisper
A very quick repo to showcase how you can experiment with Whisper (via Transformers) and make it run for your own use-cases!
All the experiments were run on a free Google Colab T4! 🔥
Results and Colab below:
| **Method** | **Time to Transcribe** |
|-----------------------------------------------|------------------------|
| fp16 | 62s |
| fp16 + SDPA | 60s |
| fp16 + SDPA + Speculative Decoding | 37.9s |
| fp16 + SDPA + Chunking + Speculative Decoding | 43.8s |
| Distil-whisper + fp16 + SDPA + Chunking | **17.2s** |