https://helsinki-nlp.github.io/shroom/

https://helsinki-nlp.github.io/shroom/

Last synced: 3 months ago
JSON representation

• Host: GitHub
• URL: https://helsinki-nlp.github.io/shroom/
• Owner: Helsinki-NLP
• Created: 2023-07-05T14:28:46.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-10-24T07:51:53.000Z (3 months ago)
• Last Synced: 2024-10-25T04:03:01.534Z (3 months ago)
• Language: SCSS
• Size: 4.67 MB
• Stars: 4
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Mu-SHROOM

SemEval-2025 Task-3 - Mu-SHROOM, the Multilingual Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

Part of the 19th International Workshop on Semantic Evaluation (SemEval 2025).

Task: Mu-SHROOM participants will need to detect grammatically sound output that contains incorrect semantic information (i.e. unsupported or inconsistent with the source input), with or without having access to the model that produced the output.

**website:** [https://helsinki-nlp.github.io/shroom/](https://helsinki-nlp.github.io/shroom/) 

# Previous iteration of the shared task

## SHROOM

SemEval-2024 Task-6 - SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

Part of the 18th International Workshop on Semantic Evaluation (SemEval 2024).

Task: SHROOM participants will need to detect grammatically sound output that contains incorrect semantic information (i.e. unsupported or inconsistent with the source input), with or without having access to the model that produced the output.

**website:** [https://helsinki-nlp.github.io/shroom/](https://helsinki-nlp.github.io/shroom/)