Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Whisper
Whisper is an autoregressive language model developed by OpenAI. It is trained on a large corpus of text using a transformer architecture and is capable of generating high-quality natural language text. Whisper can be used for tasks such as language modeling, text completion, and text generation. It has shown impressive performance on various benchmarks and has been released by OpenAI to encourage research in the field of language modeling. Whisper is not yet available for public use, but it has the potential to transform the field of natural language processing and generate new opportunities for language-based applications.
- GitHub: https://github.com/topics/whisper
- Repo: https://github.com/openai/whisper
- Created by: OpenAI
- Released: August 2021
- Related Topics: machine-learning, artificial-intelligence, language-modeling,
- Last updated: 2025-02-11 00:33:31 UTC
- JSON Representation
https://github.com/tristan-mcinnis/simultaneous-interpretation
Simultaneous-Interpretation is an advanced tool for real-time simultaneous interpretation. It transcribes and translates spoken language from a microphone input instantaneously, continually refining translations for accuracy. Ideal for business meetings, educational settings, and live events, it enhances multilingual communication effortlessly.
agents asr faster-whisper openai pyaudio simultaneous-intepreting simultaneous-translation speech-recognition speech-to-text transcription translation whisper
Last synced: 17 Jan 2025
https://github.com/tomdewildt/whisper-experiment
Experiments using the Whisper model from Open AI
colab jupyter python transcribe transformers translate whisper
Last synced: 27 Dec 2024
https://github.com/thealphamerc/audio-to-text
Transcribe multi-lingual audio clips using whisper model
Last synced: 02 Feb 2025
https://github.com/meain/raus
Record audio until silence (RAUS)
audio hammerspoon transcription whisper whisper-cpp
Last synced: 17 Jan 2025
https://github.com/escarrie/transcriptaudio
This is a script that can be used to transcript audio file into text file using Whisper AI
Last synced: 17 Jan 2025
https://github.com/ts-azure-services/batch-transcription-examples
A repo to archive some code related to batch transcription for animation movies.
batch-transcription speech-to-text whisper
Last synced: 28 Jan 2025
https://github.com/televisionninja/chat
Chat with an AI Vtuber
ai chatbot llama llm tts vtube-studio vtuber whisper
Last synced: 20 Nov 2024
https://github.com/sixiaolong1117/whisperpythonscript
一个简单的 Whisper Python 脚本,可以将媒体文件的音频通过 whisper 识别成文字,并通过 pysrt 保存为字幕。
pysrt python python3 whisper whisper-ai
Last synced: 16 Jan 2025
https://github.com/neiltron/autocap
ALL CAPS
closedcaptions ml subtitles transcription whisper
Last synced: 19 Dec 2024
https://github.com/iamarunbrahma/smart-voice-assistant
A simple voice assistant to get your queries in speech format and generate answers using ChatGPT API in both text and audio format.
Last synced: 02 Feb 2025
https://github.com/notyusheng/transcribe-translate_kubernetes
Local web app for transcription and translation services for audio and video using Whisper models
docker full-stack k8s kubernetes nodejs react reactjs self-hosted speech-to-text transcribe translate whisper
Last synced: 23 Jan 2025
https://github.com/sudiptab2100/waku-user-chat
Waku Chat using Usernames
communication-protocol decentralised-application decentralized ethereum ipfs libp2p waku waku-connect web3 whisper zk-snarks zkp
Last synced: 20 Dec 2024
https://github.com/datvm/openaiwhisperclient
A HTML page for using OpenAI Whisper API for transcripting, including making subtitles. JSON is also supported.
client-side openai subtitle timestamp transcript transcription whisper whisper-ai
Last synced: 08 Feb 2025
https://github.com/deshwalmahesh/interview-help-cheat-live
As the name suggests, it helps you cheat in your live interviews or video calls. It transcribes your audio and provides answers to your query in real time. Supports equation rendering, custom prompts, text selection and editing. It's basically chatGPT for cheating in interviews
audio-transcription chatgpt fastapi huggingface interview interviews live openai pyaudio realtime transcription transformers whisper whisper-large
Last synced: 31 Dec 2024
https://github.com/teemow/mnote
Generates meeting notes and summaries from video recordings
ai chatgpt google-meet kubeai kubernetes meeting-minutes transcription video-transcription whisper
Last synced: 02 Feb 2025
https://github.com/luluw8071/whisper-tune
Finetuning Whisper on your own voice
Last synced: 07 Feb 2025
https://github.com/mdbecker/whisper_cpp_macos_utils
Automated transcription workflow for macOS: Shell scripts to streamline audio recording, conversion, and transcription using whisper.cpp with macOS utilities like QuickTime Player and BlackHole-2ch.
audio-processing openai shell-scripts speech-to-text transcription whisper whisper-cpp
Last synced: 29 Jan 2025
https://github.com/kristofferv98/whisper_turboapi
An optimized FastAPI server for OpenAI's Whisper whisper-large-v3-turbo model using MLX turbo optimization
ai api asynchronous audio audio-processing fastapi huggingface machine-learning macos mlx model-serving nlp openai optimization python speech-to-text synchronous transcription whisper whisper-turbo
Last synced: 14 Dec 2024
https://github.com/kitschpatrol/ambient-novel
An interface for nonlinear interactive exploration of a novel.
ambient book fiction interactive novel svelte whisper
Last synced: 20 Jan 2025
https://github.com/soenneker/soenneker.runners.whisper.ctranslate
Automatically updates the Soenneker.Whisper.CTranslate package
ai csharp ctranslate ctranslate2 dotnet faster library runner runners whisper whisperctranslate
Last synced: 28 Dec 2024
https://github.com/sivakumar-mahalingam/subtitle-generator
🎞️ Automatically generating subtitles for video files using Whisper ASR model in Python
ai audio-model audio-processing automatic-speech-recognition openai-whisper python speech-recognition speech-to-text subtitle-generator whisper
Last synced: 08 Feb 2025
https://github.com/tobybenjaminclark/intermew
👨💻 Realistic, generative simulated interviews for Durhack 2024. Built using Webscraping, OpenCV, Deepface, Whisper, OpenAI and Gamemaker.
computer-vision openai-api whisper
Last synced: 25 Jan 2025
https://github.com/heng30/vtbox
It is an offline voice to text tool. Using whisper model to transcribe.
rust slint-ui voice2text whisper
Last synced: 21 Nov 2024
https://github.com/lukasbach/whisper-cpp-static
Static build of whisper.cpp by ggerganov
ai asr audio ml model recognition speech whisper
Last synced: 23 Jan 2025
https://github.com/nelzomal/videolens_ai
VideoLens AI is a powerful Chrome extension that enhances your YouTube viewing experience
ai chrome-ai gemini-nano transformers whisper wxt
Last synced: 30 Jan 2025
https://github.com/flo-bit/youtube-speaker-separation
simple python script that outputs separate audio files for each speaker in a youtube video, using whisper on replicate
speaker-diarization speech-to-text text-to-speech voice-cloning whisper youtube
Last synced: 19 Dec 2024
https://github.com/khushijtrivedi/speech
The Assistive Speech Technology System is designed to enhance communication by analyzing and processing various speech and audio inputs.
ajax bigru-crf bootstrap flask flask-server html-css-javascript librosa python restapi-framework voice-recognition whisper
Last synced: 08 Feb 2025
https://github.com/barrylee111/voicechat-llm
A chatbot with both prompt and voicechat capabilities leveraging LangChain, Elasticsearch, and FastAPI. When using voicechat, the user can immerse themselves in the experience by selecting a narrator, like a pirate for instance.
elasticsearch fastapi langchain largelanguagemodel python react speech-to-text tailwind text-to-speech typescript websocket whisper
Last synced: 19 Dec 2024
https://github.com/brunogaliati/speech2text-investments
This project automates the download, transcription, and summarization of audio from YouTube videos. Using OpenAI's Whisper model, it converts video content into concise text summaries with an investment analyst's perspective, ideal for professionals needing quick insights.
chatgpt investment openai politics python speech-recognition speech-to-text whisper
Last synced: 19 Dec 2024
https://github.com/danibcorr/university-helper
🧑🎓 University Helper streamlines academic and administrative tasks for students, educators, and researchers. It provides tools for managing document metadata, converting PDFs to Markdown, transcribing audio, analyzing grade statistics, and more.
deep-learning documentation-tool metadata ocr open-source pdf python statistics university whisper
Last synced: 19 Dec 2024
https://github.com/flaviodelgrosso/whisper-transcriber
Use OpenAI's Whisper to transcribe audio files and diariaze speakers of the transcribed text
ai audio-to-text diarization openai torch whisper
Last synced: 19 Dec 2024
https://github.com/rudrodip/kittyscribe
microservice for transcribing audio/video files to text and transcoding video
Last synced: 29 Jan 2025
https://github.com/egorsmkv/optimized-whisper-intel
Run quantized Whisper models only on CPU with Intel hardware
intel onnx onnxruntime quantized-neural-networks whisper
Last synced: 19 Dec 2024
https://github.com/devgeekm/chat-it-up
Chat It Up! elevates conversations by transforming YouTube URLs, documents, and audio into text, enabling interactive Q&A and summaries. With one click, turn media into time-saving, knowledge-rich dialogues.
ai azure azure-functions azureservices blob-storage fastapi python rag whisper youtube-dl
Last synced: 20 Dec 2024
https://github.com/eva-kaushik/multilingual-transcription-with-openai_whisper
Whisper Automatic Speech Recognition (ASR) Model
openai openai-api transcription webapp whisper
Last synced: 22 Dec 2024
https://github.com/arkaniightt/web_app_transcriptor_openai
Ferramenta de transcrição automática de áudio para texto, utilizando Streamlit e OpenAI, com suporte a microfone, vídeo e upload de arquivos de áudio.
ai app openai python streamlit tool tools transcript transcription webapp whisper
Last synced: 06 Feb 2025
https://github.com/a-iceberg/whisper_model_evaluator
WER, MER, WIL of Whisper vs Vosk vs Google transcribators comparator
asr audio-to-text automatic-speech-recognition data-analysis evaluation google-speech-recognition python tuning-parameters visualization vosk whisper
Last synced: 24 Oct 2024
https://github.com/wa-lead/audio2md
Summarizes audio using openai Whisper-1 model and GPT-Turbo3.5
audio-processing gpt-3 openai python whisper
Last synced: 26 Jan 2025
https://github.com/josemarcosrf/Lexicap-QA
QA retrieval for Lex Fridman's podcast transcriptions
Last synced: 24 Oct 2024
https://github.com/tylim88/Voicefu-back-end
Translate Speech Into Japanese
chatgpt speech-synthesis voicevox whisper
Last synced: 24 Oct 2024
https://gitlab.com/ifrz/asr-multi-lite
Testing of the main ASR frameworks with reduced models for low-resource languages speech recognition
Last synced: 24 Oct 2024
https://github.com/userpjm/whisper-youtube
Generate a SubRip subtitle file (srt) using Whisper for the audio of a YouTube video.
faster-whisper openai speech-to-text whisper
Last synced: 24 Oct 2024
https://github.com/willdphan/little-jarvis-whisper
Jarvis, a GPT Voice Assistant made with speech recognition, OpenAI's Whisper, and Gradio
gradio openai voice-assistant voice-recognition whisper
Last synced: 24 Oct 2024
https://github.com/zuplyx/subtitle-creator
Add english subtitles to videos using openai/whisper-large-v3
open-ai poetry-python python3 subtitles-generator whisper
Last synced: 09 Dec 2024
https://github.com/MattCode64/Scriba_Front
SCRIBA is a web application that transcribes audio files. It supports .mp3 files and provides the transcription results in a user-friendly interface.
speech-to-text vite vue vuejs whisper
Last synced: 24 Oct 2024
https://github.com/EvilFreelancer/whisper-tests
Collection of experiments on OpenAI Whisper models
api-server docker-compose testing transcription whisper
Last synced: 24 Oct 2024
https://github.com/yui-mhcp/speech_to_text
Speech-To-Text (STT) project
audio-transcription deepspeech jasper speech-to-text stt stt-api tensorflow2 video-transcription whisper
Last synced: 24 Oct 2024
https://github.com/paszkoo/real_time_whisper_iot
Real time voice transcription from default audio input using faster-whisper
ai iot-application iot-device smart-home voice-assistant voice-recognition whisper
Last synced: 17 Jan 2025
https://github.com/mario-huang/whisper-desktop
A desktop app for easy subtitle using whisper model.
ai desktop gradio open-source python pytorch tauri web-ui whisper
Last synced: 17 Jan 2025
https://github.com/jplhughes/whisper_logit_lens
This Alignment Jam Hackathon project explores whether the concept of "logit lens" applies to the encoder and decoder layers in Whisper, an end-to-end speech recognition model.
alignment-jam asr interpretability interpretability-jam logitlens whisper
Last synced: 24 Oct 2024
https://github.com/leafyeexyz/counselorleaf
一个随时陪伴你的 AI 心理咨询师
cloudflare-api cloudflare-pages cloudflare-workers counselling counselor javascript psychology qwen react reactjs whisper
Last synced: 11 Dec 2024
https://github.com/nicknaskida/cog-whisper-diarization
Cog implementation of transcribing + diarization pipeline with Whisper & Pyannote
diarization openai-whisper pyannote replicate speaker-diarization whisper whisper-faster whisperx
Last synced: 20 Jan 2025
https://github.com/s-emanuilov/whispercpp_kit
A wrapper on whisper.cpp with additional helper features like model management capabilities.
Last synced: 13 Dec 2024
https://github.com/codewithdark-git/talktube
A powerful Streamlit application that allows users to analyze and interact with YouTube video content through natural language questions.
agents genai genai-domain groq groq-api langchain langchain-python llm lvlm lvlms pyhton3 python rag streamlit webapp whisper youtube youtube-bot
Last synced: 10 Feb 2025
https://github.com/hanpham32/react-native-whisper
A simple text transcription web/mobile app
flask ngrok react-native transcribe whisper
Last synced: 24 Dec 2024
https://github.com/tylim88/voicefu-back-end
Translate Speech Into Japanese
chatgpt speech-synthesis voicevox whisper
Last synced: 10 Feb 2025
https://github.com/same-ou/whisper-speech-recognition
This repository contains a deployment of the Whisper speech recognition model using Flask and Python. Whisper is a cutting-edge speech recognition model designed to accurately transcribe speech input into text.
deep-learning flask machine-learning openai python pytorch whisper
Last synced: 01 Jan 2025
https://github.com/baomeomeo/speech
A Speech-To-Text (with translation) library for Go; currently uses Whisper (runs locally if needed; no need in any API keys)
ai converter go golang library module package speech speech-recognition speech-to-text text whisper
Last synced: 13 Jan 2025
https://github.com/rishabhmathur06/fine-tuning-whisper-small-for-asr-
This repository contains notebook that shows how to fine-tune OpenAI's Whisper model on custom Hindi dataset.
artificial-intelligence asr automatic-speech-recognition fine-tuning openai python whisper whisper-model
Last synced: 19 Dec 2024
https://github.com/akhkim/babel
Real-time Internal Audio Translate and Transcriber that uses Whisper model
ai internal-audio real-time transcription translation whisper
Last synced: 19 Dec 2024
https://github.com/youknow2509/real-time-speech-to-text
Speech To Text in Real-Time
blackhole speech-recognition speech-to-text whisper whisper-api
Last synced: 19 Dec 2024
https://github.com/heyfoz/python-openai-whisper
This Python script provides a simple interface to transcribe audio files using the OpenAI API's speech-to-text functionality, powered by the Whisper model. The result is returned to the console as text or VTT (WebVTT) format.
ai api audio-transcription openai python speech-to-text whisper
Last synced: 19 Dec 2024
https://github.com/geo-y20/enhanced-learning-experience
IntelliLearn is a FastAPI-based application designed to process and transcribe audio and video files into text using the Whisper model. The application also supports processing PDF files to extract and summarize their content.
chat-application chatgpt educational-project fastapi groq-api huggingface lama llm pdf-files platform python speech-to-text text-summarization transformer whisper word2vec wordembedding
Last synced: 19 Dec 2024
https://github.com/doctorpok42/pheere
Pheere is a simple virtual assistant
ai chatgpt elevenlabs ts virtual-assistant whisper
Last synced: 10 Jan 2025
https://github.com/status-im/infra-role-status-go
Ansible role for status-go
ansible-role infra waku whisper
Last synced: 05 Jan 2025
https://github.com/deepbiolab/customer-complaint-classification
An GenAI-powered pipeline leveraging Whisper, DALL-E, and GPT to transform customer complaints into actionable insights with automated transcription, visualization, and classification.
Last synced: 23 Jan 2025
https://github.com/fatma-moanes/voice-assistant
Voice Assistant for FM-Clinic: A multilingual AI-powered voice assistant for booking doctor appointments, leveraging advanced speech-to-text, text-to-speech, and large language models for seamless, natural user interactions.
ai-assistant arabic arabic-nlp aws-polly chatbot gpt groq langchain langsmith llm mongodb multilingual openai speech-recognition speech-to-text streamlit text-to-speech transcription voice-assistant whisper
Last synced: 26 Dec 2024
https://github.com/yankeexe/tiktok-summarizer
Ask questions to a Tiktok video
ai function-calling llm llm-tool-call mini-app ollama pytorch seq2seq streamlit tiktok tool-calling transformers whisper
Last synced: 02 Jan 2025
https://github.com/nazago/meeting-minutes-generator
Script which takes a .wav audio file, performs speech-to-text using OpenAI/Whisper, and then, using Llama3, summarization and action point from the transcript generated
langchain-python llm-inference local-inference meeting-minutes ollama speech-to-text summarization whisper
Last synced: 02 Jan 2025
https://github.com/aitor-alvarez/whisper-lightning-finetuning
Whisper fine-tuning using Lightning
acoustic-features acoustic-model speech-recognition torch-lightning whisper
Last synced: 02 Jan 2025
https://github.com/asai95/speech-recognition-api
Simple but extensible API for Speech Recognition.
Last synced: 02 Jan 2025
https://github.com/sugarcane-mk/whisper
This repository provides a Python script for extracting speech embeddings using OpenAI's Whisper model. The embeddings are high-dimensional feature vectors that capture the acoustic properties of the input audio. These embeddings can be used for downstream tasks such as speech classification, clustering, and speaker recognition.
asr classification feature-extraction openai speech-processing speech-recognition speech-to-text svm-classifier whisper
Last synced: 02 Jan 2025
https://github.com/yjg30737/pyqt-simple-whisper-gui
Whisper text-to-speech, speech-to-text example in PyQt5 GUI
openai pyqt pyqt-ai pyqt5 pyqt5-desktop-application pyqt5-examples pyqt5-gui whisper
Last synced: 03 Jan 2025
https://github.com/mrbuslov/reminder_4u_bot
AI Telegram Bot Reminder. You send a free-form text OR voice reminder, the AI bot records it and reminds you at the right time!
ai ai-bot aiogram chatgpt django gpt-3 gpt-4 gpt-models python reminder telegram-bot voice-recognition whisper
Last synced: 10 Jan 2025
https://github.com/studiowebux/tommygotchi
whisper, piper, llama-gpt, python, fun .. so much fun !
llama-gpt piper python3 whisper whisper-ai
Last synced: 05 Jan 2025
https://github.com/andreykolomiets/local_speech_translator
Almost online speech translation on Apple Silicon laptops with CoreML enabled. Doesn't need any APIs, all work is done locally using OpenAI's excellent Whisper model. Also https://github.com/ggerganov/whisper.cpp repo is used to build Whisper with CoreML support, enhancing speed significantly
coreml dash fastapi hebrew hebrew-english whisper whisper-cpp
Last synced: 07 Feb 2025
https://github.com/zakariaf/whisperwave
AI-powered audio transcription app using OpenAI Whisper, Flask, and Vue. Upload .wav files, select a language, and get accurate transcriptions. Fully Dockerized!
audio-processing docker flask python speech-to-text transcription vite vue whisper
Last synced: 07 Feb 2025
https://github.com/werserk/techstormhack-1st-place
Решение соревнования ТехШторм от корпорации ТатНефть по анализу активности членов команды на ВКС
pyannote speaker-diarization speech-recognition streamlit whisper
Last synced: 11 Jan 2025
https://github.com/jgurakuqi/auto-subtitles-generator
A utility based on neural networks for generating srt subtitles from common video formats
faster-whisper ffmpeg neural-network python whisper
Last synced: 26 Jan 2025
https://github.com/charlot-dedjinou/hackathon-ia-multimodal-multilingue
Lors de ce hackathon, nous avons développé la solution Smart VT, une application web basée sur l'IA conçue pour sous-titrer et doubler n'importe quelle vidéo d'une langue à une autre (selon votre choix). Le projet s'appuie sur un frontend en React, des API Python pour le traitement des vidéos, et Node.js pour la gestion des sous-titres vidéo.
api dubble fastapi ffmpeg googletranslator mongodb moviepy nodejs openia reactjs subtitles whisper
Last synced: 12 Jan 2025
https://github.com/waikato-llm/whisper
Docker images for the whisper audio transcription library and variants.
Last synced: 12 Jan 2025
https://github.com/hsiehbocheng/yt-gen-caption
This is a Porject for generating captions for YouTube videos using Faster Whisper & yt_dlp.
Last synced: 19 Dec 2024
https://github.com/lohiyah/vidcraft
VidCraft is an AI-driven backend application that generates videos from user-defined topics and backgrounds. It combines text, audio, and visuals using advanced AI services, making video creation accessible and efficient for developers and content creators alike.
ai elevenlabs fastapi ffmpgeg full-stack-web-development gemini-ai huggingface image-generation machine-learning reactjs subtitles text-to-speech typescript video-generation whisper
Last synced: 18 Jan 2025
https://github.com/velocitatem/dontlectureme
A program that pays attention to your lectures for you.
ai lectures university whisper
Last synced: 30 Jan 2025
https://github.com/electroneum/electroneum-web3.js
Electroneum SmartChain JavaScript API
api electroneum ethereum etn-sc javascript swarm typescript whisper
Last synced: 19 Jan 2025
https://github.com/isladot/speech-to-text-whisper
A speech-to-text converter powered by OpenAI's Whisper model. Easy-to-use tool for transcribing audio into text with high accuracy.
ai python s2t speech-to-text whisper
Last synced: 19 Jan 2025
https://github.com/nanext21/vidcraft
VidCraft is an AI-driven backend application that generates videos from user-defined topics and backgrounds. It combines text, audio, and visuals using advanced AI services, making video creation accessible and efficient for developers and content creators alike.
elevenlabs fastapi ffmpgeg full-stack-web-development gemini-ai github-config image-generation machine-learning mern-project subtitles typescript video-generation whisper whisper-ai
Last synced: 19 Jan 2025