Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jitsi/jiwer
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
https://github.com/jitsi/jiwer
automatic-speech-recognition evaluation-metrics python3 speech-to-text wer word-error-rate
Last synced: 4 days ago
JSON representation
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
- Host: GitHub
- URL: https://github.com/jitsi/jiwer
- Owner: jitsi
- License: apache-2.0
- Created: 2018-06-19T00:38:38.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2024-05-06T14:12:30.000Z (6 months ago)
- Last Synced: 2024-10-29T23:50:33.434Z (14 days ago)
- Topics: automatic-speech-recognition, evaluation-metrics, python3, speech-to-text, wer, word-error-rate
- Language: Python
- Homepage:
- Size: 762 KB
- Stars: 627
- Watchers: 15
- Forks: 96
- Open Issues: 15
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# JiWER
JiWER is a simple and fast python package to evaluate an automatic speech recognition system.
It supports the following measures:
1. word error rate (WER)
2. match error rate (MER)
3. word information lost (WIL)
4. word information preserved (WIP)
5. character error rate (CER)
These measures are computed with the use of the minimum-edit distance between one or more reference and hypothesis sentences.
The minimum-edit distance is calculated using [RapidFuzz](https://github.com/maxbachmann/RapidFuzz), which uses C++ under the hood, and is therefore faster than a pure python implementation.
## Documentation
For further info, see the documentation at [jitsi.github.io/jiwer](https://jitsi.github.io/jiwer).
## Installation
You should be able to install this package using [poetry](https://python-poetry.org/docs/):
```
$ poetry add jiwer
```
Or, if you prefer old-fashioned pip and you're using Python >= `3.7`:
```bash
$ pip install jiwer
```
## Usage
The most simple use-case is computing the word error rate between two strings:
```python
from jiwer import wer
reference = "hello world"
hypothesis = "hello duck"
error = wer(reference, hypothesis)
```
## Licence
The jiwer package is released under the `Apache License, Version 2.0` licence by [8x8](https://www.8x8.com/).
For further information, see [`LICENCE`](./LICENSE).
## Reference
_For a comparison between WER, MER and WIL, see: \
Morris, Andrew & Maier, Viktoria & Green, Phil. (2004). [From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition.](https://www.researchgate.net/publication/221478089_From_WER_and_RIL_to_MER_and_WIL_improved_evaluation_measures_for_connected_speech_recognition)_