Projects in Awesome Lists tagged with low-resource-languages

https://github.com/RichardLitt/endangered-languages

Resources for conservation, development, and documentation of low resource (human) languages.

awesome awesome-list endangered-languages human-language language-documentation language-learning language-resources list low-resource-languages lrls minority-language natural-language natural-language-processing nlp resourced-languages

Last synced: 10 Apr 2025

https://github.com/cisnlp/GlotLID

Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

glot glotcc glotlid langid language-classification language-detection language-detection-lib language-detection-library language-detector language-identification language-identification-toolkit language-identifier language-recognition lid low-resource-languages low-resource-nlp multlingual

Last synced: 08 May 2025

https://github.com/ljvmiranda921/calamancy

NLP pipelines for Tagalog using spaCy

computational-linguistics low-resource-languages low-resource-nlp machine-learning natural-language-processing ner nlp spacy

Last synced: 06 Apr 2025

https://github.com/richardlitt/thesis

My thesis on "Open Source Code and Low Resource Languages" for an MSc in Language Science and Technology at Saarland University

dissertation endangered-languages low-resource-languages lrl nlp nlproc saarland saarland-university thesis

Last synced: 14 Mar 2026

https://github.com/alecokas/bilatticernn-confidence

Confidence Estimation for Black Box Automatic Speech Recognition Systems Using Lattice Recurrent Neural Networks https://arxiv.org/abs/1910.11933 or https://ieeexplore.ieee.org/document/9053264

asr attention confidence-estimates confidence-estimation confidence-scores confusion-networks lattice latticernn lattices low-resource-languages lstm pytorch pytorch-implementation speech-processing speech-recognition

Last synced: 05 Jul 2025

https://github.com/clefourrier/coppermt

[ACL 2021, Findings] Cognate Prediction Per Machine Translation

acl2021 cognate-prediction cognates fairseq low-resource-languages low-resource-machine-translation machine-translation nmt smt

Last synced: 26 Apr 2025

https://github.com/alecokas/swahili-text-gcn

Graph Convolutional Network for Swahili News Classification: https://arxiv.org/abs/2103.09325

gcn graph-convolutional-networks graph-neural-networks low-resource-languages natural-language-processing python pytorch semi-supervised-learning swahili text-classification

Last synced: 18 Aug 2025

https://github.com/khuangaf/concrete

Official implementation of "CONCRETE: Improving Cross-lingual Fact Checking with Cross-lingual Retrieval" (COLING'22)

cross-lingual-transfer fact-checking low-resource-languages multilinguality retrieval

Last synced: 30 Apr 2025

https://github.com/mokha/verdd

Veʹrdd is an open-source dictionary editing framework with the focus on low-resourced and endangered languages. The framework is mainly built to facilitate collecting, importing, editing and exporting dictionaries while allowing the involvement of the native speakers to contribute easily to the preservation of the language and construction of the dictionary.

dictionary editing low-resource-languages

Last synced: 22 Jan 2026

https://github.com/michael-beukman/nertransfer

[IJCNLP-AACL 2023] Investigating transfer learning in low-resourced languages, specifically in a named entity recognition (NER) task. http://arxiv.org/abs/2309.05311

low-resource-languages ner nlp

Last synced: 13 Sep 2025

https://github.com/mahtafetrat/mana-forced-aligner

A robust forced alignment tool for low-resource languages using multiple ASR models and CER-based matching. Built for noisy data and imperfect transcripts.

asr forced-alignment low-resource-languages mana-tts manatts open-source speech-alignment speech-dataset tts

Last synced: 19 Jun 2025

https://github.com/worldbank/llms-practical-guide

A practical introduction to Generative AI and LLMs, equipping professionals with essential skills to apply Gen AI in workflows, data processes, and tool development through hands-on labs and case studies.

generative-ai llm low-resource-languages

Last synced: 24 Apr 2025

https://github.com/nicolay-r/rusentne-llm-benchmark

This repository highlights the LLMs reasoning capabilities of ✨ Mistral / LLaMA-3 / Phi-3 / Gemma / Flan-T5 / GPT-4o ✨ in Targeted Sentiment Analysis in Russian / Translated to English mass-media 📊

chain-of-thought fine-tuning gemma gpt4 gpt4o leaderboard llama3 llm llms low-resource-languages low-resource-nlp mistral openai prompt reasoning sentiment-analysis transformers-library zero-shot

Last synced: 17 May 2026

https://github.com/rexshijaku/alb-fake-news-corpus

The First Ever Albanian Fake News Corpus

albanian-language dataset fake-news fake-news-detection low-resource-languages

Last synced: 31 Jan 2026

https://github.com/devrimcavusoglu/nonwestlit

NONWESTLIT Project Codebase

dataset low-resource-languages low-resource-nlp multilingual

Last synced: 28 Feb 2026

https://github.com/zabir-nabil/bangla-multilingual-llm-eval

Evaluation of Open and Closed-Source Multi-lingual LLMs for Low-Resource Bangla Language

bangla large-language-model large-language-models llm-evaluation low-resource-languages

Last synced: 13 Jul 2025

https://github.com/strickvl/balochi-tokenizer

A custom tokenizer for the Balochi language.

balochi low-resource-languages nlp

Last synced: 15 Mar 2025

https://github.com/tverney/llm-proxy-babylon

Multilingual LLM proxy that optimizes non-English prompts for better quality, lower token costs, and stronger safety alignment

ai-safety aws-bedrock cost-optimization language-detection llm low-resource-languages multilingual openai-api prompt-optimization proxy token-optimization translation

Last synced: 20 Apr 2026

https://github.com/ljvmiranda921/ud-tagalog-spacy

Training a POS Tagger and Dependency Parser for a Low-Resource Language (Tagalog)

low-resource-languages machine-learning nlp spacy tagalog

Last synced: 29 Apr 2026

https://github.com/dsfsi/zabantu-beta

ZaBantu is a fleet of light-weight Masked Language Models for Southern Bantu Languages

low-resource-languages nlp roberta sotho tshivenda tsonga xlm-roberta zulu

Last synced: 16 Jun 2026

https://github.com/ndamulelonemakh/our-stopwords

Auto-generated stopwords for South African Bantu Languages

african-languages africanlp dataset low-resource-languages natural-language-processing nlp stopwords tshivenda

Last synced: 06 Oct 2025

https://github.com/mdm-code/manx

Fine-tune LLM for early Middle English lemmatization with data from LAEME.

deep-learning lemmatization lemmatizer low-resource-languages low-resource-machine-learning low-resource-nlp middle-english neural-network nlp nlp-machine-learning parsing

Last synced: 29 Jan 2026

https://github.com/greenw0lf/msc-vt-thesis

Scripts and files I used throughout my Master thesis.

frisian low-resource-languages speech-recognition xls-r

Last synced: 06 Oct 2025

https://github.com/dsfsi/embedding-eval-data

Embedding Evaluation Data for South African Languages

africa dsfsi-datasets low-resource-languages machine-learning nlp nlproc south-africa

Last synced: 17 Feb 2026

https://github.com/mrapacz/interlinear-translation

Morphology-enhanced neural models for Ancient Greek interlinear translation, achieving 35-38% BLEU improvements for English and Polish translations. Includes custom T5 implementations and training code. [LoResLM@COLING2025]

ancient-greek coling coling2025 deep-learning interlinear-translation low-resource-languages machine-translation morphology neural-networks nlp t5 transformers

Last synced: 17 Jan 2026

https://github.com/haturusinghe/subasa-plm

A framework for adapting Pretrained Language Models (XLM-R, BERT etc.) for Low-Resourced Offensive Language Detection in Sinhala using pretrained models and intermediate tasks.

finetuning-llms low-resource-languages nlp offensive-language-detection xlm-roberta

Last synced: 31 Mar 2025