Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/facebookresearch/SimulEval
SimulEval: A General Evaluation Toolkit for Simultaneous Translation
https://github.com/facebookresearch/SimulEval
Last synced: 3 months ago
JSON representation
SimulEval: A General Evaluation Toolkit for Simultaneous Translation
- Host: GitHub
- URL: https://github.com/facebookresearch/SimulEval
- Owner: facebookresearch
- License: cc-by-sa-4.0
- Created: 2020-08-11T17:42:10.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2024-07-24T19:43:49.000Z (4 months ago)
- Last Synced: 2024-07-25T20:24:17.532Z (4 months ago)
- Language: Python
- Homepage:
- Size: 8.75 MB
- Stars: 95
- Watchers: 17
- Forks: 34
- Open Issues: 27
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
- Awesome-Simultaneous-Translation - SimulEval
README
# SimulEval
[![](https://github.com/facebookresearch/SimulEval/workflows/build/badge.svg)](https://github.com/facebookresearch/SimulEval/actions)SimulEval is a general evaluation framework for simultaneous translation on text and speech. Full documentation can be found [here](https://simuleval.readthedocs.io/en/v1.1.0/).
## Installation
```
git clone https://github.com/facebookresearch/SimulEval.git
cd SimulEval
pip install -e .
```## Quick Start
Following is the evaluation of a [dummy agent](examples/quick_start) which operates wait-k (k = 3) policy and generates random words until the length of the generated words is the same as the number of all the source words.
```shell
cd examples/quick_start
simuleval --source source.txt --target target.txt --agent first_agent.py
```# License
SimulEval is licensed under Creative Commons BY-SA 4.0.
# Citation
Please cite as:
```bibtex
@inproceedings{simuleval2020,
title = {Simuleval: An evaluation toolkit for simultaneous translation},
author = {Xutai Ma, Mohammad Javad Dousti, Changhan Wang, Jiatao Gu, Juan Pino},
booktitle = {Proceedings of the EMNLP},
year = {2020},
}
```