An open API service indexing awesome lists of open source software.

https://github.com/rhasspy/wyoming-whisper-cpp

Wyoming protocol server for whisper.cpp
https://github.com/rhasspy/wyoming-whisper-cpp

Last synced: 9 days ago
JSON representation

Wyoming protocol server for whisper.cpp

Awesome Lists containing this project

README

        

# Wyoming Whisper.cpp

[Wyoming protocol](https://github.com/rhasspy/wyoming) server for the [whisper.cpp](https://github.com/ggerganov/whisper.cpp) speech to text system.

## Local Install

Install dependencies:

```sh
sudo apt-get install build-essential
```

Clone the repository and set up Python virtual environment:

``` sh
git clone https://github.com/rhasspy/wyoming-whisper-cpp.git
cd wyoming-whisper-cpp
script/setup
```

Build the whisper.cpp `main` executable:

```sh
make -C whisper.cpp/ main
```

Run a server anyone can connect to:
```sh
script/run \
--whisper-cpp-dir ./whisper.cpp \
--model tiny.en-q5_1 \
--language en \
--uri 'tcp://0.0.0.0:10300' \
--data-dir /data \
--download-dir /data
```

## Docker Image

``` sh
docker run -it -p 10300:10300 -v /path/to/local/data:/data rhasspy/wyoming-whisper-cpp \
--data-dir /data --model tiny.en-q5_1 --language en
```

[Source](https://github.com/rhasspy/wyoming-addons/tree/master/whisper-cpp)

## GPU Support

For more advanced use cases, consider the community-built [wyoming-whisper-api-client](https://github.com/ser/wyoming-whisper-api-client)