https://helsinki-nlp.github.io/shroom/
https://helsinki-nlp.github.io/shroom/
Last synced: 8 months ago
JSON representation
- Host: GitHub
- URL: https://helsinki-nlp.github.io/shroom/
- Owner: Helsinki-NLP
- Created: 2023-07-05T14:28:46.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-04-09T13:06:24.000Z (8 months ago)
- Last Synced: 2025-04-09T13:43:28.794Z (8 months ago)
- Language: SCSS
- Size: 4.76 MB
- Stars: 7
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-hallucination-detection - SemEval-2024 Task-6 - SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes
README
# Mu-SHROOM
SemEval-2025 Task-3 - Mu-SHROOM, the Multilingual Shared-task on Hallucinations and Related Observable Overgeneration Mistakes
Part of the 19th International Workshop on Semantic Evaluation (SemEval 2025).
Task: Mu-SHROOM participants will need to detect grammatically sound output that contains incorrect semantic information (i.e. unsupported or inconsistent with the source input), with or without having access to the model that produced the output.
**website:** [https://helsinki-nlp.github.io/shroom/](https://helsinki-nlp.github.io/shroom/)
# Previous iteration of the shared task
## SHROOM
SemEval-2024 Task-6 - SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes
Part of the 18th International Workshop on Semantic Evaluation (SemEval 2024).
Task: SHROOM participants will need to detect grammatically sound output that contains incorrect semantic information (i.e. unsupported or inconsistent with the source input), with or without having access to the model that produced the output.
**website:** [https://helsinki-nlp.github.io/shroom/](https://helsinki-nlp.github.io/shroom/)