Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with language-identification

A curated list of projects in awesome lists tagged with language-identification .

https://github.com/googlesamples/mlkit

A collection of sample apps to demonstrate how to use Google's ML Kit APIs on Android and iOS

barcode barcode-scanner face-detection google image-labeling language-identification ml-kit mlkit mlkit-android object-detection smart-reply text-recognition translation

Last synced: 23 Apr 2025

https://github.com/pemistahl/lingua-py

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

language-classification language-detection language-identification language-recognition natural-language-processing nlp python-library

Last synced: 14 May 2025

https://github.com/modelscope/3d-speaker

A Repository for Single- and Multi-modal Speaker Verification, Speaker Recognition and Speaker Diarization

3d-speaker campplus cnceleb eres2net language-identification modelscope rdino speaker-diarization speaker-verification voxceleb

Last synced: 14 May 2025

https://github.com/pemistahl/lingua-rs

The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

language-classification language-detection language-identification language-processing language-recognition natural-language-processing nlp nlp-machine-learning rust rust-crate rust-library

Last synced: 13 May 2025

https://github.com/FireRedTeam/FireRedASR2S

A SOTA Industrial-Grade All-in-One ASR system with ASR, VAD, LID, and Punc modules. FireRedASR2 supports Chinese (Mandarin, 20+ dialects/accents), English, code-switching, and both speech and singing ASR. FireRedVAD supports speech/singing/music in 100+ langs. FireRedLID supports 100+ langs and 20+ zh dialects. FireRedPunc supports zh and en.

asr asr-pipeline audio-event-classification audio-event-detection automatic-speech-recognition industrial-grade language-identification lid llm multimodal-llm open-source punctuation-prediction punctuation-restoration sota speech-recognition speechllm vad voice-activity-detection

Last synced: 06 May 2026

https://github.com/echogarden-project/echogarden

Cross-platform speech toolset, used from the command-line or as a Node.js library. Includes a variety of engines for speech synthesis, speech recognition, forced alignment, speech translation, voice isolation, language detection and more.

command-line forced-alignment language-detection language-identification node-js source-separation speech speech-alignment speech-recognition speech-synthesis speech-to-text speech-translation text-to-speech voice-isolation

Last synced: 15 May 2025

https://github.com/apcode/tensorflow_fasttext

Simple embedding based text classifier inspired by fastText, implemented in tensorflow

fasttext language-identification tensorflow text-classifier

Last synced: 27 Mar 2025

https://github.com/LlmKira/fast-langdetect

⚡️ 80x faster Fasttext language detection out of the box | Split text by language

detect-languages fasttext i18n language-identification languagedetector svc tts

Last synced: 15 May 2025

https://github.com/llmkira/fast-langdetect

⚡️ 80x faster Fasttext language detection out of the box | Split text by language

detect-languages fasttext i18n language-identification languagedetector svc tts

Last synced: 05 Apr 2025

https://github.com/nitotm/efficient-language-detector-js

Fast and accurate natural language detection. Detector written in Javascript. Nito-ELD, ELD.

javascript language language-detection language-detector language-identification natural-language natural-language-processing nlp nodejs

Last synced: 05 Apr 2025

https://github.com/zkmkarlsruhe/language-identification

Spoken Language Identification on Common Voice and AudioSet using Deep Learning

audioset common-voice intelligent-museum language-identification lid spoken-language-identification zkm

Last synced: 15 Feb 2026

https://github.com/currentslab/fastlangid

fastlangid, the only language identification package that support cantonese (zh-yue), simplified (zh-hans) and traditional chinese (zh-hant)

cantonese-language fasttext identification language-identification language-identifier simplified-chinese traditional-chinese

Last synced: 17 Mar 2026

https://github.com/mbanon/fastspell

Targetted language identifier, based on FastText and Hunspell.

fasttext hunspell language-identification nlp

Last synced: 18 Jan 2026

https://github.com/sagorbrur/codeswitch

CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed data.

code-mixed code-switching codeswitch hindi-english huggingface language-identification ner nlp pos pos-tagging sentiment-analysis spanish-english transformers

Last synced: 02 Sep 2025

https://github.com/dataiku/dss-plugin-nlp-preparation

Dataiku DSS plugin to detect languages, correct misspellings, and clean text data 🧼

auto-correct dataiku dss-plugin language-detection language-identification natural-language-processing nlp spell-checker text-cleaning

Last synced: 04 Apr 2026

https://github.com/joshdevins/demo-es-lang-ident

Demo: Elasticsearch Language Identification

demo elasticsearch language-identification nlp search

Last synced: 14 Jul 2025

https://github.com/jonsafari/witch-language

Easy language identification of 380 languages

bad-pun language-identification python

Last synced: 06 Nov 2025

https://github.com/nitotm/efficient-language-detector-py

Fast and accurate natural language detection. Detector written in Python. Nito-ELD, ELD.

language language-detection language-detector language-identification natural-language natural-language-processing npl python

Last synced: 09 Oct 2025

https://github.com/skit-ai/map-mix

The official implementation of the method discussed in the paper Improving Spoken Language Identification with Map-Mix(work accepted at ICASSP-2023)

confidence-labels datamaps hubert language-identification mixup speech-processing spoken-language-identification spoken-language-recognition wav2vec2 xlsr

Last synced: 06 Jan 2026

https://github.com/commoncrawl/language-detection-cld2

Natural language detection, Java bindings for CLD2

language-detection language-identification natural-language

Last synced: 12 Jun 2025

https://github.com/gluschenko/panlingo

Collection of language detection libraries for .NET: FastText, CLD2, CLD3, MediaPipe, Lingua, Whatlang

cld2 cld3 dotnet dotnet-core fasttext interop language-detection language-identification lingua machine-learning mediapipe neural-networks nlp whatlang wrapper

Last synced: 25 Jun 2025

https://github.com/yunsii/fasttext.wasm.js

Node and Browser env supported WebAssembly version of fastText: Library for efficient text classification and representation learning.

browser browser-extension fasttext language language-detection language-detector language-identification natural-language natural-language-processing nlp node nodejs wasm web-extension webassembly worker

Last synced: 28 Apr 2025

https://github.com/zjaume/heliport

Fast and accurate language identifier

language-detection language-identification nlp python rust

Last synced: 17 Jul 2025

https://github.com/alvations/bayesline-dsl

A Multinomial Bayesian Classification for Language Identification

language-identification naive-bayes python textcat vardial

Last synced: 30 Apr 2025

https://github.com/bung87/whatlangid

This project is build on top of whatthelang and langid

language-detection language-identification

Last synced: 11 Apr 2025

https://github.com/hemangsk/capacitor-mlkit-language

Capacitor Plugin implementing Language Identification on Android & iOS using Google's on-device ML library - ML Kit

android capacitor capacitor-plugin ios language-identification mlkit

Last synced: 12 Apr 2026

https://github.com/stratosblue/languageidentification

.NET Port of Language Identification Library for langid-java. 移植自langid-java的语言识别库。

langid langid-csharp langid-dotnet language-detection language-identification

Last synced: 12 Apr 2025

https://github.com/andrianllmm/taglid

A word-level Language Identification (LID) tool for Tagalog-English (Taglish) text

code-mixing code-switching english language-identification linguistics nlp tagalog taglish

Last synced: 10 Apr 2026

https://github.com/proycon/colibri-utils

NLP utilities that rely on Colibri Core: currently only language identification

computational-linguistics historical-linguistics language-detection language-identification nlp

Last synced: 21 Feb 2026

https://github.com/cschen1205/cs-nlp-language-identifier

A language identifier built using NLP NGram language model

language-identification language-model ngrams nlp

Last synced: 19 May 2026

https://github.com/vhidvz/language-identification

Language identification microservice powered by the FastText language detection model

ai fastapi fasttext language-identification

Last synced: 05 Jan 2026

https://github.com/bhattbhavesh91/language-identification-using-python

A small tutorial on how you can detect language using Python, Fasttext, Google Compact Language Detector and Google Translate

cld3 fasttext google-language google-translate language-identification python python-tutorial tutorial

Last synced: 03 May 2026

https://github.com/jjlee0802cu/open-set-lid

Open-set speech language identification https://arxiv.org/abs/2205.10397

language-identification pytorch speech-recognition

Last synced: 15 May 2026

https://github.com/naetherm/tedextract

Small script for the extraction of video subtitles of TED videos.

dataset language-identification ted ted-talks text-extraction

Last synced: 01 Sep 2025

https://github.com/samarjit98/indic-languages-tech-paper

Leveraging Latent Representations for Indian Language Identification

language-identification machine-learning speech-processing

Last synced: 18 Feb 2026

https://github.com/mohamed-devp/language-identification-with-cnns

Train and evaluate a deep learning model capable of identifying six distinc languages with 99% accuracy.

convolutional-neural-networks deep-learning language-identification natural-language-processing

Last synced: 13 Jul 2026

https://github.com/alichtman/text-language-identifier

Accurately identify written English, French or Italian text with up to 99% accuracy.

bigram-model language-identification language-model linguistic-analysis n-grams text-classification-python text-processing

Last synced: 29 Jul 2025

https://github.com/xi/tiny-lang-detect

Generate tiny models for language detection

langdetect language-identification

Last synced: 08 Aug 2025

https://github.com/silentflame/language-identification

Language identification at sentence as well as word level in both monolingual as well as code-mixed bilingual texts

char-embedding jupyter-notebook language-identification lstm ml nlp nlp-machine-learning python3 tf-idf

Last synced: 16 Apr 2026