Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/twardoch/gimeltra
No-nonsense simple transliteration between writing systems, mostly of Semitic origin
https://github.com/twardoch/gimeltra
ancient-languages semitic-languages transliteration transliterator unicode unicode-converter writing-systems
Last synced: 3 days ago
JSON representation
No-nonsense simple transliteration between writing systems, mostly of Semitic origin
- Host: GitHub
- URL: https://github.com/twardoch/gimeltra
- Owner: twardoch
- License: mit
- Created: 2021-08-07T14:21:28.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2024-01-05T19:07:47.000Z (12 months ago)
- Last Synced: 2024-12-20T23:31:12.577Z (13 days ago)
- Topics: ancient-languages, semitic-languages, transliteration, transliterator, unicode, unicode-converter, writing-systems
- Language: Python
- Homepage: https://twardoch.github.io/gimeltra
- Size: 250 KB
- Stars: 8
- Watchers: 3
- Forks: 5
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
- Authors: AUTHORS.md
Awesome Lists containing this project
README
# Gimeltra
Gimeltra is a Python 3.9+ tool for simple transliteration between 20+ writing systems, mostly of Semitic origin.
Gimeltra performs simplified abjad-only transliteration, and is primarily intended for translating simple texts from modern to ancient scripts. It uses a non-standard romanization scheme. Arabic, Greek or Hebrew letters outside the basic consonant set will not transliterate.
## Installation
```sh
python3 -m pip install --upgrade git+https://github.com/twardoch/gimeltra
```
## Usage
### Command-line
```sh
$ gimeltrapy -h
usage: gimeltrapy [-h] [-t TEXT] [-i FILE] [-s SCRIPT] [-o SCRIPT] [--stats] [-v] [-V]
optional arguments:
-h, --help show this help message and exit
-t TEXT, --text TEXT
-i FILE, --input FILE
-s SCRIPT, --script SCRIPT
Input script as ISO 15924 code
-o SCRIPT, --to-script SCRIPT
Output script as ISO 15924 code
--stats List supported scripts
-v, --verbose -v show progress, -vv show debug
-V, --version show version and exit
```
Examples:
```sh
$ gimeltrapy -t "لرموز"
lrmwz
$ gimeltrapy -t "لرموز" -o Hebr
לרמוז
$ gimeltrapy -t "لرموز" -o Narb
𐪁𐪇𐪃𐪅𐪘
$ gimeltrapy -t "لرموز" -o Sogo
𐼌𐼘𐼍𐼇𐼈
```
Or from stdin / via piping:
```sh
$ echo لرموز | gimeltrapy -o Grek
λρμυζ
```
### Python
```python
from gimeltra.gimeltra import Transliterator
tr = Transliterator()
print(tr.tr("لرموز", sc='Arab', to_sc='Hebr')
```
Less efficient:
```python
from gimeltra import tr
print(tr("لرموز")
```
## Supported scripts / tech background
Gimeltra supports 24 scripts:
- `Latn` (Latin)
- `Arab` (Arabic)
- `Ethi` (Ethiopic)
- `Armi` (Imperial Aramaic)
- `Brah` (Brahmi)
- `Chrs` (Chorasmian)
- `Egyp` (Egyptian hieroglyphs)
- `Elym` (Elymaic)
- `Grek` (Greek)
- `Hatr` (Hatran)
- `Hebr` (Hebrew)
- `Mani` (Manichaean)
- `Narb` (Old North Arabian)
- `Nbat` (Nabataean)
- `Palm` (Palmyrene)
- `Phli` (Inscriptional Pahlavi)
- `Phlp` (Psalter Pahlavi)
- `Phnx` (Phoenician)
- `Prti` (Inscriptional Parthian)
- `Samr` (Samaritan)
- `Sarb` (Old South Arabian)
- `Sogd` (Sogdian)
- `Sogo` (Old Sogdian)
- `Syrc` (Syriac)
- `Ugar` (Ugaritic)
### Conversion steps
The conversion uses the [`.json`](gimeltra/gimeltra_data.json) file derived from the `.tsv` table. The selection of the conversion rules is based on ISO 15924 script codes. The code mimics a simple OpenType glyph processing model, but with Unicode characters:
#### 1. Preprocessing with a `ccmp` table
1. Split ligatures into single letters, also
2. Decompose into Unicode NFD and drop the marks.
#### 2. Character replacement in the `csub` table
1. Try direct source-target script mapping.
2. If that does not exist, convert into `Latn`.
3. Try from `Latn` to target script
4. If that’s not available, fallback from `Latn` to `` prefix means that we should only convert to this character but not from it
- `~` prefix indicates that this is a final form
- `%` separates the from and to strings of a character ligature
(Keep on mind that if the characters in the table are RTL, the browser renders the entire cell as RTL and changes `>` to `<` and vice versa 😀 )
The `Latn` column serves as the intermediary (all conversions are done from the source script through `Latn` to the target script). The column contains some characters that have equivalents only in some scripts. This allows less lossy coversion between, say, Hebrew and Arabic or Ethiopic and Old South Arabian.
The `β|<Β | 𐣡 | בּ | 𐫁 | 𐪈 | 𐢃|~𐢂 | 𐡡 | 𐭡 | 𐮁 | 𐤁 | 𐭁 | ࠁ | 𐩨 | 𐼱 | 𐼂|~𐼃 | ܒ | 𐎁 |
| g | | Gimel | غ | ገ | 𐡂 | 𑀕 | 𐾳 | 𓌙 | 𐿢 | γ|<Γ | 𐣢 | ג | 𐫃 | 𐪔 | 𐢄 | 𐡢 | 𐭢 | 𐮂 | 𐤂 | 𐭂 | ࠂ | 𐩴 | 𐼲 | 𐼄 | ܓ|<ܔ | 𐎂 |
| d | | Daleth | د | ደ | 𐡃 | 𑀥 | 𐾴 | 𓇯 | 𐿣 | δ|<Δ | 𐣣 | ד | 𐫅 | 𐪕 | 𐢅 | 𐡣 | 𐭣 | 𐮃 | 𐤃 | 𐭃 | ࠃ | 𐩵 | 𐼹 | 𐼌 | ܕ|<ܕ݂ | 𐎄 |
| h | | He | ه | ሀ | 𐡄 | 𑀳 | 𐾵 | 𓀠 | 𐿤 | ε|<Ε | 𐣤 | ה | 𐫆 | 𐪀 | 𐢇|~𐢆 | 𐡤 | 𐭤 | 𐮄 | 𐤄 | 𐭄 | ࠄ | 𐩠 | 𐼳 | 𐼆|~𐼅 | ܗ | 𐎅 |
| w | | Waw | و | ወ | 𐡅 | 𑀯 | 𐾶|<𐾷 | 𓏲 | 𐿥 | υ|<Υ | 𐣥 | ו | 𐫇 | 𐪅 | 𐢈 | 𐡥 | >𐭥 | >𐮅 | 𐤅 | 𐭅 | ࠅ | 𐩥 | 𐼴 | 𐼇 | ܘ | 𐎆 |
| z | | Zayin | ز | ዘ | 𐡆 | 𑀚 | 𐾸 | 𓏭 | 𐿦 | ζ|<Ζ | 𐣦 | ז | 𐫉 | 𐪘 | 𐢉 | 𐡦 | 𐭦 | 𐮆 | 𐤆 | 𐭆 | ࠆ | >𐩹 | 𐼵 | 𐼈 | ܙ | 𐎇 |
| ḥ | | Het | ح | ሐ | 𐡇 | 𑀖 | 𐾹 | 𓉗 | 𐿧 | η|<Η | 𐣧 | ח | 𐫍 | 𐪂 | 𐢊 | 𐡧 | 𐭧 | 𐮇 | 𐤇 | 𐭇 | ࠇ | 𐩢 | 𐼶 | 𐼉 | ܚ|<ܚ݂ | 𐎈 |
| ṭ | | Tet | ط | ጠ | 𐡈 | 𑀣 | >𐿄 | 𓄤 | 𐿨 | θ|<Θ | 𐣨 | ט | 𐫎 | 𐪉 | 𐢋 | 𐡨 | 𐭨 | >𐮑 | 𐤈 | 𐭈 | ࠈ | 𐩷 | >𐽃 | >𐼔 | ܛ|<ܜ | 𐎉 |
| y | | Yod | ي | የ | 𐡉 | 𑀬 | 𐾺 | 𓂝 | 𐿩 | ι|<Ι | 𐣩 | י | 𐫏 | 𐪚 | 𐢍|~𐢌 | 𐡩 | 𐭩 | 𐮈 | 𐤉 | 𐭉 | ࠉ | 𐩺 | 𐼷 | 𐼊 | ܝ | 𐎊 |
| k | | Kaf | ك | ከ | 𐡊 | 𑀓 | 𐾻 | 𓂧 | 𐿪 | κ|<Κ | 𐣪 | כ|~ך | 𐫐 | 𐪋 | 𐢏|~𐢎 | 𐡪 | 𐭪 | 𐮉 | 𐤊 | 𐭊 | ࠊ | 𐩫 | 𐼸 | 𐼋 | ܟ|<ܟ݂ | 𐎋 |
| l | | Lamd | ل | ለ | 𐡋 | 𑀮 | 𐾼 | 𓌅 | 𐿫 | λ|<Λ | 𐣫 | ל | 𐫓 | 𐪁 | 𐢑|~𐢐 | 𐡫 | 𐭫 | 𐮊 | 𐤋 | 𐭋 | ࠋ | 𐩡 | 𐽄 | >𐼌 | ܠ | 𐎍 |
| m | | Mem | م | መ | 𐡌 | 𑀫 | 𐾽 | 𓈖 | 𐿬 | μ|<Μ | 𐣬 | מ|~ם | 𐫖 | 𐪃 | 𐢓|~𐢒 | 𐡬 | 𐭬 | 𐮋 | 𐤌 | 𐭌 | ࠌ | 𐩣 | 𐼺 | 𐼍 | ܡ | 𐎎 |
| n | | Nun | ن | ነ | 𐡍 | 𑀦 | 𐾾 | 𓆓 | 𐿭 | ν|<Ν | 𐣭 | נ|~ן | 𐫗 | 𐪌 | 𐢕|~𐢔 | 𐡭|<𐡮 | 𐭭 | 𐮌 | 𐤍 | 𐭍 | ࠍ | 𐩬 | 𐼻 | 𐼎|~𐼏 | ܢܢ|<ܢ | 𐎐 |
| s | | Samekh | س | ሰ | 𐡎 | 𑀱 | 𐾿 | 𓊽 | 𐿮 | σ|~ς|<Σ | 𐣮 | ס | 𐫘 | 𐪊 | 𐢖 | 𐡯 | 𐭮 | 𐮍 | 𐤎 | 𐭎 | ࠎ | 𐩪 | 𐼼 | 𐼑 | ܣ | 𐎒 |
| ʿ | | Ain | ع | ዐ | 𐡏 | 𑀏 | 𐿀 | 𓁹 | 𐿯 | ο|<ω|<Ο|<Ω | 𐣯 | ע | 𐫙 | 𐪒 | 𐢗 | 𐡰 | 𐭥 | 𐮅 | 𐤏 | 𐭏 | ࠏ | 𐩲 | 𐼽 | 𐼓|<𐼒 | ܥ | 𐎓 |
| p | | Pe | پ | ፐ | 𐡐 | 𑀧 | 𐿁 | 𓂋 | 𐿰 | π|<Π | 𐣰 | פ|~ף | 𐫛 | >𐪐 | 𐢘 | 𐡱 | 𐭯 | 𐮎 | 𐤐 | 𐭐 | >ࠐ | >𐩰 | 𐼾 | 𐼔 | ܦ | 𐎔 |
| ṣ | | Sade | ض | ጸ | 𐡑 | 𑀘 | >𐾿 | 𓇑 | 𐿱 | ϻ|<Ϻ | 𐣱 | צ|~ץ | 𐫝 | 𐪎 | 𐢙 | 𐡲 | 𐭰 | 𐮏 | 𐤑 | 𐭑 | ࠑ | 𐩮 | 𐼿 | 𐼕|~𐼖 | ܨ | 𐎕 |
| q | | Qof | ق | ቀ | 𐡒 | 𑀔 | >𐾻 | 𓃻 | 𐿲 | ϙ|<Ϙ | 𐣲 | ק | 𐫞 | 𐪄 | 𐢚 | 𐡳 | 𐭬 | 𐮋 | 𐤒 | 𐭒 | ࠒ | 𐩤 | >𐼸 | >𐼋 | ܩ | 𐎖 |
| r | | Resh | ر | ረ | 𐡓 | 𑀭 | 𐿂 | 𓁶 | 𐿳 | ρ|<Ρ | 𐣣 | ר | 𐫡 | 𐪇 | 𐢛 | 𐡴 | >𐭥 | >𐮅 | 𐤓 | 𐭓 | ࠓ | 𐩧 | 𐽀 | 𐼘 | ܪ | 𐎗 |
| š | | Shin | ش | ሠ | 𐡔 | 𑀰 | 𐿃 | 𓌓 | 𐿴 | ξ|<Ξ | 𐣴 | ש | 𐫢 | 𐪏 | 𐢝|~𐢜 | 𐡵 | 𐭱 | 𐮐 | 𐤔 | 𐭔 | ࠔ | 𐩦 | 𐽁 | 𐼙 | ܫ | 𐎌|<𐎝 |
| t | | Tau | ت | ተ | 𐡕 | 𑀢 | 𐿄 | 𓏴 | 𐿵 | τ|<Τ | 𐣵 | ת | 𐫤 | 𐪗 | 𐢞 | 𐡶 | 𐭲 | 𐮑 | 𐤕 | 𐭕 | ࠕ | 𐩩 | 𐽂 | 𐼚|~𐼛 | ܬ | 𐎚 |
| ḍ | d | | ض | | | | | | | | | | | 𐪓 | | | | | | | | | | | | |
| f | p | | ف | ፈ | | | | | | φ|<Φ | | פּ|~ףּ | | 𐪐 | | | | | | | ࠐ | 𐩰 | 𐽃 | >𐼔 | | |
| ġ | h | | | | | | | | | | | גּ | | 𐪖 | | | | | | | | | | | | 𐎙 |
| ḏ | d | | ذ | | | | | | | | | דּ | | | | | | | | | | 𐩹 | | | | |
| ḵ | k | | خ | | | | | | | | | כּ|~ךּ | | | | | | | | | | | | | | |
| ḫ | ḥ | | | ኀ | | | | | | | | | | | | | | | | | | 𐩭 | | | | |
| j | g | | ج | | | | | | | | | ג׳ | | | | | | | | | | | | | | |
| v | b | | | | | | | | | β | | ב | | | | | | | | | | | | | | 𐎜 |
| č | tš | | چ | ፀ | | | | | | | | צ׳|~ץ׳ | | | | | | | | | | | | | | |
| ṯ | t | | ث | | | | | | | | | תּ | | | | | | | | | | | | | | 𐎘 |
| ẓ | z | | ظ | | | | | | | | | | | | | | | | | | | | | | | 𐎑 |
| ž | z | | | | | | | | | | | ז׳ | | | | | | | | | | | | | | |
| p̣ | p | | | ጰ | | | | | | | | | | | | | | | | | | | | | | |
| | | | | | | | | | | | | | | | | | | | | | | | | 𐼓𐼌%𐼧 | | |
## License
Copyright © 2021 Adam Twardoch, [MIT license](./LICENSE)
## Other projects of interest
- [Wiktra](https://github.com/kbatsuren/wiktra/) — Python transliterator for 100+ scripts and 500+ languages, mostly into Latin but in some cases across other scripts. Uses the Wiktionary transliteration modules written in Lua. Needs Lua runtime.
- [Aksharamukha](https://github.com/virtualvinodh/aksharamukha-python) - Python (plus [JS and web](https://github.com/virtualvinodh/aksharamukha)) transliterator within the Indic cultural sphere, for 94 scripts and 8 romanization methods. Does conversion between scripts.