https://github.com/impresso/impresso-mulitlingual-dictionary-annotations
https://github.com/impresso/impresso-mulitlingual-dictionary-annotations
Last synced: 2 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/impresso/impresso-mulitlingual-dictionary-annotations
- Owner: impresso
- Created: 2026-05-28T11:55:53.000Z (12 days ago)
- Default Branch: main
- Last Pushed: 2026-06-03T14:12:47.000Z (6 days ago)
- Last Synced: 2026-06-03T14:15:31.369Z (6 days ago)
- Language: Python
- Size: 110 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Multilingual Dictionary Seed Annotation
Small terminal tool for validating German-to-target word pairs.
Purpose: create better seed word pairs for aligning monolingual static word embeddings, improving the final multilingual embedding space and dictionary.
## Files
- `pivot_seed_candidates_1to1_clustered_500x4.jsonl`: candidate word pairs
- `annotate_seed_candidates.py`: terminal annotation script
- `annotations/seed_annotations.json`: shared output file created while annotating
## Run
First time only, clone the repository:
```bash
git clone git@github.com:impresso/impresso-mulitlingual-dictionary-annotations.git
cd impresso-mulitlingual-dictionary-annotations
```
Before starting, always pull the latest annotations:
```bash
git pull
```
```bash
python annotate_seed_candidates.py
```
Please read the instructions printed by the script before starting.
The displayed words are normalized forms, not necessarily original surface forms.
For each language pair, enter how many new examples to annotate. Enter `0` to skip a pair.
During annotation:
- `t` = correct translation
- `f` = wrong translation
- `s` = skip if you do not know the word or are very unsure; it does not count, and another random pair is shown
- `b` = go back
- `q` = quit and save
Skipped pairs are not saved as annotations, so the number you enter means the number of `t`/`f` decisions you will contribute.
Annotation rules:
- Focus on the semantics of the two words. If the target word is overall a correct semantic translation of the source word, mark it as true.
- Ignore capitalization and OCR/spelling errors if the intended word is clear.
- Ignore inflectional differences if the meaning is otherwise correct: tense, singular/plural, gender, and grammatical case such as nominative, accusative, dative, or genitive.
- If either word is in the wrong language for its column, mark it as false.
- If the two words are identical, mark it as false.
- For words with multiple meanings, judge the most common meaning of each word. Mark true if the common meanings match.
- Mark false if the match only works through a rare or unusual meaning of one word.
## After Annotating
Push your changes so the next annotator starts from the latest file:
```bash
git add annotations/seed_annotations.json
git commit -m "Added X new checked pairs - NAME"
git push
```
Replace `X` with the number of new `t`/`f` decisions you added, and replace `NAME` with your name.