https://github.com/Nikorasu/LiveWhisper

A nearly-live implementation of OpenAI's Whisper, using sounddevice. Requires existing Whisper install.
https://github.com/Nikorasu/LiveWhisper

ai assistant chatbot dictation numpy openai openai-whisper python sounddevice speech-recognition speech-to-text terminal text-to-speech transcription translation tts voice voice-assistant voice-recognition whisper

Last synced: about 22 hours ago
JSON representation

A nearly-live implementation of OpenAI's Whisper, using sounddevice. Requires existing Whisper install.

• Host: GitHub
• URL: https://github.com/Nikorasu/LiveWhisper
• Owner: Nikorasu
• License: mit
• Created: 2022-10-06T21:57:33.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-12-28T20:41:58.000Z (11 months ago)
• Last Synced: 2024-10-29T20:55:30.303Z (14 days ago)
• Topics: ai, assistant, chatbot, dictation, numpy, openai, openai-whisper, python, sounddevice, speech-recognition, speech-to-text, terminal, text-to-speech, transcription, translation, tts, voice, voice-assistant, voice-recognition, whisper
• Language: Python
• Homepage:
• Size: 54.7 KB
• Stars: 329
• Watchers: 9
• Forks: 45
• Open Issues: 7
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LiveWhisper - Whisper based transcription

`livewhisper.py` outputs psuedo-live sentence-by-sentence dictation to terminal.

Using [OpenAI's Whisper](https://github.com/openai/whisper) model, and sounddevice library to listen to microphone.

Audio from mic is stored if it hits a volume & frequency threshold, then when

silence is detected, it saves the audio to a temp file and sends it to Whisper.

*Dependencies:* Whisper, numpy, scipy, sounddevice

LiveWhisper can somewhat work as an alternative to [SpeechRecognition](https://github.com/Uberi/speech_recognition).

Although that now has it's own Whisper support, so it's up to you. ;)

---

## Whisper Assistant

I've also included `assistant.py`, which using livewhisper as a base, is my

attempt at making a simple voice-command assistant like Siri, Alexa, or Jarvis.

Same dependencies as livewhisper, as well as requests, pyttsx3, wikipedia, bs4.

*Also needs:* espeak and python3-espeak.

The voice assistant can be activated by saying it's name, default "computer",

"hey computer" or "okay computer" also work. You can wait for the computer to

then respond, or immediately request an action/question without pausing.

Available features: Weather, date & time, tell jokes, & do wikipedia searches.

It can also handle some other requests, like basic math or real simple trivia.

Tho that relies on Google's instant-answer snippets & sometimes doesn't work.

Control media-players using: play, pause, next, previous, stop, what's playing?

Media controls need some form of noise/echo cancelling enabled to work right.

See [this page](https://www.linuxuprising.com/2020/09/how-to-enable-echo-noise-cancellation.html) for more information on how to enable that in Linux PulseAudio.

You can close the assistant via `ctrl+c`, or by saying it's name & "terminate".

---

If you like my projects and want to help me keep making more,

please consider donating on [my Ko-fi page](https://ko-fi.com/nik85)! Thanks!

[![ko-fi](https://ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/F1F4GRRWB)