Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-urdu
π A curated list of resources dedicated to Urdu language.
https://github.com/urduhack/awesome-urdu
- Web news Data - Urdu Web news Data
- Roman Urdu Dataset - Data for sentiment analysis, along with misc compiled data for Roman Urdu
- Collection of Urdu Datasets - Datasets for POS, NER and NLP tasks
- Urdu Universal Dependency Treebank
- UrduSummary Corpus Benchmark, 2016
- Rekhta Ghazals
- Urdu Paraphrase Plagiarism Corpus, 2016
- COrpus of Urdu News TExt Reuse (CoUNTeR), 2016
- Urdu Short Text Reuse Corpus (USTRC), 2018
- TaPaCo: A Corpus of Sentential Paraphrases for 73 Languages
- Flickr8k Urdu Image-Caption Generation Dataset, 2020
- mLAMA: multilingual LAnguage Model Analysis, 2021
- Urdu Word Segmentation using CRF, 2018
- Apertium linguistic data for Urdu
- Fake News Classification, 2020 - News-Augmented-Dataset))
- iNLTK Urdu News Headlines Classification Benchmark, 2020
- Express News Headlines+Summary, 2019
- MK-PUCIT-NER, 2019
- WikiAnn: Cross-lingual Name Tagging & Linking, 2017
- UFAL Corpus, 2014 - 5.4M sentences (with POS tags)
- OSCAr Corpus, 2020
- CC-100 Corpus, 2019 - CC crawls from Jan-Dec 2018
- WMT Raw 2017 - CC crawls from 2012-2016
- iNLTK Wiki Articles, 2020 - NLP/Tatoeba-Challenge/blob/master/data/Backtranslations.md), [2016 UrduWikiCorpus](http://urdu-corpus.blogspot.com/p/published-packages.html)
- WiToKit
- Leipzig Corpora
- MaαΈ΅αΊzan
- UrduWaC-2010 and urTenTen-2018, SketchEngine
- A Gold Standard Urdu Raw Text Corpus, LDCIL
- Urdu IMDb Movie Reviews - IMDB Movie Reviews data in Urdu
- Urdu Sentiment Benchmark, 2020
- 2010 Disaster Response Messages
- Urdu Sentiment Lexicon
- Sentiment Polarity Lexicons, 2017
- Hate Speech & Offensive Language Detection, 2020 - 10k tweets
- UCI Roman-Urdu Sentiment Classification, 2018 - 20k records
- Did You Offend Me? Classification of Offensive Tweets, 2018 - 3k tweets
- Qaida - Synthetic datasets and pre-trained models
- U-HAT - Urdu Hand-Written Text Dataset
- 45K+ Clean-Background-Urdu-Ligatures-Dataset, 2019
- IIIT-Hyderabad: Unconstrained OCR for Urdu using Deep CNN-RNN Hybrid Networks, 2017
- CLE Pakistan Urdu Image Corpora
- Cursive-Text: A Benchmark for Urdu Text Recognition in Natural Scene Images, 2020 - 2500 images, email for dataset
- OPUS Corpora - >ur)
- CC-Aligned - 1310/), [OpenSubtitles](https://www.aclweb.org/anthology/L16-1147/), [TED](https://www.ted.com/participate/translate), [QED](https://www.aclweb.org/anthology/L14-1675/), etc.
- IIIT-Hyderabad MT Bhasha
- PM India Parallel Corpus
- English-Urdu Religious Parallel Corpus
- Anuvaad Parallel Corpora
- MechanicalTurks 2012 Parallel Corpora
- Urdu-Nepali-English Parallel Corpus
- Cross-Language English-Urdu (CLEU) Corpus, 2018
- Flickr 8k Benchmark - 2.7k sentences
- Universal Declaration of Human Rights (benchmark)
- EMILLE/CIIL Corpus - Contains monolingual data as well
- National Platform for Language Technology
- Technology Development for Indian Languages
- Google Dakshina, 2020
- TRANSLIT: A Large-scale Name Transliteration Resource, 2020
- Roman to Urdu Transliteration Sentences, 2020
- Roman-Urdu Conversion Data
- Trilingual Ur-RomUr-Eng Dict, 2019
- Offline Eng-Urd Dictionary DB
- UrduHack Words-List - Includes N-grams, NER Labels
- CLE Urdu WordNet
- Verb List
- IndoWordnet Parallel Corpus - [pyiwn](https://github.com/riteshpanjwani/pyiwn), [Demo](https://www.cfilt.iitb.ac.in/indowordnet/))
- MTurks-10k Multilingual Dictionary, 2014
- Microsoft IT Terminology
- Urdu N-grams, 2020 - Uni-Gram, Bi-Gram, Tri-Gram and Tetra-Gram
- CLE Urdu Books N-Grams
- Roman Urdu Lexical Normalization, 2019
- Urdu 250 Isolated Words, 2018
- CLE Phonetically Rich Urdu Speech Corpus
- CMU Wilderness Speech Dataset, 2019
- FCBH Recordings
- LibriVox AudioBooks
- CLE Pakistan Urdu Speech Corpus
- LDC UPenn Datasets - Filter search by selecting language
- Urdu Raw Speech Corpus, LDCIL
- LDCIL ASR Corpus
- Urdu-Sindhi Speech Emotion Corpus, 2020 - Introducing_the_Urdu_Sindhi_Speech_Emotion_Corpus.pdf))
- Speech Emotion Recognition Benchmark, 2018
- Cross-lingual Natural Language Inference (XNLI) Corpus, 2020
- Google XTrEME Benchmark, 2020 - Evaluation of cross-lingual generalization of multilingual models
- Urdu-Punjabi Pairs, Apertium
- UrduHack
- PronouncUR - Urdu words to pronouniciations format
- iNLTK
- Indic PoS/NER Tagger
- Urdu Morphological Analyzer, IIIT Hyderabad
- EasyOCR
- HuggingFace Models
- Google Multilingual-T5, 2020
- Google MuRIL, 2020
- iNLTK Models, 2019
- XLM-RoBERTa, 2019
- Multilingual BERT, 2019
- UrduHack Word-Vectors, 2019 - Word2Vec and FastText models
- Wiki-2016 - 2017](https://fasttext.cc/docs/en/crawl-vectors.html), [Multilingual Aligned, 2017](https://github.com/babylonhealth/fastText_multilingual)
- BPEmb: Subword Embeddings, 2017 - its.org/bpemb/multi/))
- ConceptNet Embeddings, 2017
- Polyglot Embeddings, 2013
- IL-Multi, 2020
- Facebook M2M-100, 2020
- Python Translators Services - Library to use Google, Bing, etc. translators for free
- PolyGlot
- LibIndicTrans - Transliterate Roman/Hindi to Urdu and vice-versa
- AksharaMukhi - Devanagari (Hindi) to Urdu script converter
- Google Transliterate API - Roman Urdu to Perso-Arabic
- Pakistani Center for Language Engineering - Online Services
- JANG Group
- BBC Urdu
- Voice of America Urdu
- Nawa-i-Waqt Group
- Urdu Point Network
- More news websites
- ur.oxforddictionaries.com - Oxford Dictionary
- English Urdu Dictionary - English Urdu Dictionary
- Urdu English Dictionary 2 - Urdu English Dictionary 2
Keywords
urdu
8
nlp
5
urdu-language
4
dataset
4
machine-learning
3
urdu-nlp
2
dictionary
2
natural-language-processing
2
indian-languages
2
hindi
2
ocr
2
pytorch
2
sentiment-analysis
2
ner
2
urdu-datasets
1
urdu-ligatures
1
urdu-recognition
1
urdu-dataset
1
english
1
roman-urdu
1
autosuggestion
1
backer
1
bigram
1
ner-labels
1
sponsors
1
trigram
1
urdu-words
1
words-collection
1
pronunciation-dictionary
1
pronunciation-lexicon
1
speech-recognition
1
spacy-models
1
summarization
1
urdu-model
1
data
1
language-model
1
parser
1
rekhta
1
caption-generation
1
image-captioning
1
urdu-image-captioning
1
crf
1
segmentation
1
apertium-languages
1
dump
1
multilingual
1
tokenize
1
wikipedia
1
wikipedia-dump
1
text-classification
1