Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ros-ai/ros2_whisper
Whisper C++ Inference Action Server for ROS 2
https://github.com/ros-ai/ros2_whisper
Last synced: 23 days ago
JSON representation
Whisper C++ Inference Action Server for ROS 2
- Host: GitHub
- URL: https://github.com/ros-ai/ros2_whisper
- Owner: ros-ai
- Created: 2023-01-19T11:28:28.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-06-21T17:07:39.000Z (5 months ago)
- Last Synced: 2024-06-22T09:35:53.164Z (5 months ago)
- Language: C++
- Homepage:
- Size: 438 KB
- Stars: 26
- Watchers: 2
- Forks: 5
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.rst
Awesome Lists containing this project
- awesome-foundation-model-ros - ros2_whisper - ROS 2 wrapper for whisper.cpp. (Research-Grade Frameworks)
- awesome-foundation-model-ros - ros2_whisper - ROS 2 wrapper for whisper.cpp. (Research-Grade Frameworks)
README
# ROS 2 Whisper
ROS 2 inference for [whisper.cpp](https://github.com/ggerganov/whisper.cpp).## Build
- Install `pyaudio`, see [install instructions](https://pypi.org/project/PyAudio/).
- Build this repository, do
```shell
mkdir -p ros-ai/src && cd ros-ai/src && \
git clone https://github.com/ros-ai/ros2_whisper.git && cd .. && \
colcon build --symlink-install --cmake-args -DWHISPER_CUDA=On --no-warn-unused-cli
```## Demos
Run the inference action server (this will download models to `$HOME/.cache/whisper.cpp`):
```shell
ros2 launch whisper_bringup bringup.launch.py
```
Run a client node (activated on space bar press):
```shell
ros2 run whisper_demos whisper_on_key
```Configure `whisper` parameters in [whisper.yaml](whisper_server/config/whisper.yaml).
## Available Actions
Action server under topic `inference` of type [Inference.action](whisper_idl/action/Inference.action).## Troubleshoot
- Encoder inference time: https://github.com/ggerganov/whisper.cpp/issues/10#issuecomment-1302462960