Projects in Awesome Lists tagged with language-classification

https://github.com/pemistahl/lingua-py

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

language-classification language-detection language-identification language-recognition natural-language-processing nlp python-library

Last synced: 14 May 2025

https://github.com/pemistahl/lingua-go

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

go golang-library language-classification language-detection language-identification language-modeling language-processing language-recognition natural-language-processing nlp nlp-machine-learning text-processing

Last synced: 14 May 2025

https://github.com/pemistahl/lingua-rs

The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

language-classification language-detection language-identification language-processing language-recognition natural-language-processing nlp nlp-machine-learning rust rust-crate rust-library

Last synced: 13 May 2025

https://github.com/pemistahl/lingua

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

android-library java-library kotlin-library language-classification language-detection language-identification language-processing language-recognition natural-language natural-language-processing nlp nlp-library nlp-machine-learning

Last synced: 04 Oct 2025

https://github.com/oscar-project/ungoliant

:spider: The pipeline for the OSCAR corpus

common-crawl commoncrawl corpus-linguistics crawler fasttext language-classification nlp oscar

Last synced: 03 Apr 2025

https://github.com/cisnlp/GlotLID

Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

glot glotcc glotlid langid language-classification language-detection language-detection-lib language-detection-library language-detector language-identification language-identification-toolkit language-identifier language-recognition lid low-resource-languages low-resource-nlp multlingual

Last synced: 08 May 2025

https://github.com/nitotm/efficient-language-detector

Fast and accurate natural language detection. Detector written in PHP. Nito-ELD, ELD.

language language-classification language-detection language-detector language-identification natural-language natural-language-processing nlp php

Last synced: 19 Apr 2026

https://github.com/thunderpoot/isogloss

ISO 639 and IETF Language Code Lookup Tool

bcp47 command-line command-line-tool ietf-language-tag ietf-language-tags iso-3166-1 iso639 iso639-1 iso639-2 iso639-3 language-classification languages locales localization python shell-script

Last synced: 12 Sep 2025

https://github.com/mc-cat-tty/language-classification

Suite of Python modules to recognise the language of a file

csv files flask frequency-table itis-fermi-modena language language-analyzer language-classification language-classifier language-recognition python python3 twitter

Last synced: 29 Apr 2026

https://github.com/azagniotov/language-detection

This is a refined and re-implemented version of the archived plugin for ElasticSearch elasticsearch-langdetect, which itself builds upon the original work by Nakatani Shuyo, found at https://github.com/shuyo/language-detection. The aforementioned implementation by Nakatani Shuyo serves as the default language detection component within Apache Solr.

language-classification language-classifier language-detection language-detection-api language-detection-lib language-detection-library language-detector language-model language-recognition linguistic linguistic-analysis linguistics naive-bayes naive-bayes-algorithm naive-bayes-classifier natual-language-processing natural-language natural-language-understanding nlp