Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/Smat26/Roman-Urdu-Dataset
Compilation of Manually Tagged Roman Urdu Dataset (Urdu written in Latin/Roman Script), along with other helpful Roman Urdu NLP resources
https://github.com/Smat26/Roman-Urdu-Dataset
data-science dataset hindi hindi-language natural-language-processing nlp urdu urdu-language urdu-nlp
Last synced: 3 months ago
JSON representation
Compilation of Manually Tagged Roman Urdu Dataset (Urdu written in Latin/Roman Script), along with other helpful Roman Urdu NLP resources
- Host: GitHub
- URL: https://github.com/Smat26/Roman-Urdu-Dataset
- Owner: Smat26
- License: gpl-3.0
- Created: 2019-01-05T14:19:41.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2020-10-06T11:56:07.000Z (about 4 years ago)
- Last Synced: 2024-04-06T22:32:43.865Z (7 months ago)
- Topics: data-science, dataset, hindi, hindi-language, natural-language-processing, nlp, urdu, urdu-language, urdu-nlp
- Size: 709 KB
- Stars: 31
- Watchers: 4
- Forks: 15
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-urdu - Roman Urdu Dataset - Data for sentiment analysis, along with misc compiled data for Roman Urdu (Urdu Datasets / General NLP Datasets)
README
# Roman Urdu Dataset
[](https://github.com/Smat26/Roman-Urdu-Dataset/blob/master/LICENSE)
>This is an extensive compilation of Roman Urdu Dataset (Urdu written in Latin/Roman Script), along with other helpful Roman Urdu NLP resources.
## Motivation
One of the biggest hurdle when working with NLP in Urdu is the lack of comprehensive dataset in the domain unlike other languages. The above resources are therefore a culmination of that effort.
The data is organized so to facilitate other researchers and hobbyist, and help promote research.
Application code for the Roman Urdu NLP can be found here
---
## Description
### Dateset
The dataset consist of sentences gathered from reviews of various e-commerce website, comments on public facebook pages, and twitter accounts. Each row would ideally consist of a single sentence and have a corresponding sentiment attach to it, which would be either `Negative`, `Positive` or `Neutral`.
There are more than 20,000 sentences and they have been manually tagged.
### Dictionary
It contains English meaning of Roman Urdu words.
### Conversion
It consist of words between languages in form of:
```
: :
```
### Negative-and-Positive-Words
It contains negative and positive words for sentiment analysis.
```
: :
```
### Urdu-Names
This contains list of common Urdu (Pakistani) names.
---
## Credits
The main dataset compilation for Roman-Urdu NLP processing was done as part of research effort by Zareen Sharf.
More info here: https://archive.ics.uci.edu/ml/datasets/Roman+Urdu+Data+Set
The dataset consist of data gathered from reviews of various e-commerce website, comments of public facebook pages, and twitter accounts,
Other data have been gathered from wikipedia, and various resources online.
## Contributing
To facilitate more people to actively work in the domain it is requested that if you are building on from these resources, do try to contribute, extend or optimize the current datasets.
If you know of a data source that is not listed here, let me know.
To do so, you can open a Pull Request with the dataset added in to the relevant file, or just open an issue and mention the dataset & link.
## Usage
You are free to use this dataset for your purposes, do credit the original author, and I would appreciate if you can drop me in a message :)
## Used in
- https://www.kaggle.com/smat26/sentiment-analysis-on-roman-urdu/
- https://www.kaggle.com/smat26/roman-urdu-dataset
## License
This project is licensed under the GNU General Public License v3.0 - see the LICENSE.md file for details