Projects in Awesome Lists tagged with language-identification

https://github.com/googlesamples/mlkit

A collection of sample apps to demonstrate how to use Google's ML Kit APIs on Android and iOS

barcode barcode-scanner face-detection google image-labeling language-identification ml-kit mlkit mlkit-android object-detection smart-reply text-recognition translation

Last synced: 01 Oct 2024

https://github.com/pemistahl/lingua-go

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

go golang-library language-classification language-detection language-identification language-modeling language-processing language-recognition natural-language-processing nlp nlp-machine-learning text-processing

Last synced: 01 Oct 2024

https://github.com/pemistahl/lingua-py

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

language-classification language-detection language-identification language-recognition natural-language-processing nlp python-library

Last synced: 26 Sep 2024

https://github.com/pemistahl/lingua-rs

The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

language-classification language-detection language-identification language-processing language-recognition natural-language-processing nlp nlp-machine-learning rust rust-crate rust-library

Last synced: 30 Sep 2024

https://github.com/pemistahl/lingua

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

android-library java-library kotlin-library language-classification language-detection language-identification language-processing language-recognition natural-language natural-language-processing nlp nlp-library nlp-machine-learning

Last synced: 31 Jul 2024

https://github.com/apcode/tensorflow_fasttext

Simple embedding based text classifier inspired by fastText, implemented in tensorflow

fasttext language-identification tensorflow text-classifier

Last synced: 31 Jul 2024

https://github.com/textpipe/textpipe

Textpipe: clean and extract metadata from text

language-identification named-entities named-entity-recognition nlp text-analysis text-processing

Last synced: 01 Aug 2024

https://github.com/adbar/simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

corpus-tools language-detection language-identification lemmatiser lemmatization lemmatizer low-resource-nlp morphological-analysis nlp tokenization tokenizer wordlist

Last synced: 03 Aug 2024

https://github.com/LlmKira/fast-langdetect

⚡️ 80x faster language detection with Fasttext | Split text by language for TTS

detect-languages fasttext i18n language-identification languagedetector svc tts

Last synced: 04 Aug 2024

https://github.com/cisnlp/GlotLID

GlotLID: Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

glot langid language-classification language-detection language-detection-lib language-detection-library language-detector language-identification language-identification-toolkit language-identifier language-recognition lid low-resource-languages low-resource-nlp multlingual

Last synced: 03 Aug 2024

https://github.com/rosette-api/python

Rosette API Client Library for Python

categorization entity-extraction fuzzy-matching language-detection language-identification lemmatization machine-learning morphology name-generation name-similarity name-translation natural-language-processing nlp python relation-extraction sentiment-analysis text text-analysis text-mining tokenization

Last synced: 03 Aug 2024

https://github.com/nitotm/efficient-language-detector-js

Fast and accurate natural language detection. Detector written in Javascript. Nito-ELD, ELD.

javascript language language-detection language-detector language-identification natural-language natural-language-processing nlp nodejs

Last synced: 28 Sep 2024

https://github.com/martinthoma/lidtk

Language Identification Toolkit

language-identification language-identification-toolkit machine-learning mit-license nlp nlp-machine-learning python-3 python-3-5

Last synced: 01 Oct 2024

https://github.com/sinaahmadi/CORDI

Language and Speech Technology for Central Kurdish Varieties (LREC-COLING 2024)

automatic-speech-recognition dialect-identification erbil kurdish kurdish-language-processing language-identification machine-translation mahabad sanandaj sorani sulaymaniyah

Last synced: 03 Aug 2024

https://github.com/sinaahmadi/PersoArabicLID

PALI: Language identification for Perso-Arabic Scripts

arabic balochi brahui gilaki gorani kashmiri kurdish kurmanji language-identification mazanderani pashto persian punjabi saraiki sindhi sorani southern-kurdish torwali urdu uyghur

Last synced: 31 Jul 2024

https://github.com/rosette-api/csharp

Rosette API Client Library for C#

capi csharp entity-extraction language-identification machine-learning morphology name-translation natural-language-processing nlp nuget rosette text-analysis text-analytics text-embedding visual-studio

Last synced: 03 Aug 2024

https://github.com/rosette-api/php

Rosette API Client Library for PHP

entity-extraction language-identification lemma morphology named-entity-recognition natural-language-processing nlp php text-analytics text-embedding tokenization

Last synced: 03 Aug 2024

https://github.com/rosette-api/ruby

Rosette API Client Library for Ruby

deduplication entity-extraction language-identification machine-learning morphology named-entity-recognition natural-language-processing nlp ruby sentiment-analysis text-analytics text-embedding tokenization

Last synced: 03 Aug 2024

https://github.com/sinaahmadi/KurdishLID

Language identification of Kurdish and Zaza-Gorani languages (& variants)

arabic feyli gorani hawrami kurdish kurdish-language-processing kurdish-oss kurmanji language-identification less-resource-languages persian sorani southern-kurdish turkish zazaki

Last synced: 03 Aug 2024

https://github.com/hemangsk/capacitor-mlkit-language

Capacitor Plugin implementing Language Identification on Android & iOS using Google's on-device ML library - ML Kit

android capacitor capacitor-plugin ios language-identification mlkit

Last synced: 04 Aug 2024

https://github.com/proycon/colibri-utils

NLP utilities that rely on Colibri Core: currently only language identification

computational-linguistics historical-linguistics language-detection language-identification nlp

Last synced: 02 Oct 2024

https://github.com/vhidvz/language-identification

Language identification microservice powered by the FastText language detection model

ai fastapi fasttext language-identification

Last synced: 30 Sep 2024