https://github.com/i4ds/swisstext-2021-task-3
https://github.com/i4ds/swisstext-2021-task-3
Last synced: 6 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/i4ds/swisstext-2021-task-3
- Owner: i4Ds
- License: mit
- Created: 2021-06-21T11:49:42.000Z (almost 5 years ago)
- Default Branch: main
- Last Pushed: 2021-06-21T12:00:02.000Z (almost 5 years ago)
- Last Synced: 2025-06-18T01:51:29.006Z (about 1 year ago)
- Language: Python
- Size: 2.93 KB
- Stars: 0
- Watchers: 6
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# swisstext-2021-task-3
Code to evaluate submissions for the SwissText 2021 Shared Task 3, "Swiss German Speech to Standard German Text".
1. Download the ground truth files private.csv and public.csv of the "All Swiss German Dialects Test Set" to the same directory as bleu.py. The test set is available here: https://www.cs.technik.fhnw.ch/i4ds-datasets
2. Copy the submission you want to evaluate to the same directory as bleu.py and rename it to submission.csv. Make sure the format is correct. Check the template example_submission.csv in the "All Swiss German Dialects Test Set".
3. Run bleu.py.
4. The first score is the BLEU score on the public part of the test set, the second score is the BLEU score on the private part.