https://github.com/andrianllmm/tgl-dictionary-parser
Parser for a Tagalog dictionary website
https://github.com/andrianllmm/tgl-dictionary-parser
dictionary parser tagalog text-mining web-scraping
Last synced: 4 days ago
JSON representation
Parser for a Tagalog dictionary website
- Host: GitHub
- URL: https://github.com/andrianllmm/tgl-dictionary-parser
- Owner: andrianllmm
- License: apache-2.0
- Created: 2024-08-09T10:42:13.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2025-06-22T18:32:42.000Z (about 1 year ago)
- Last Synced: 2025-06-22T19:35:02.915Z (about 1 year ago)
- Topics: dictionary, parser, tagalog, text-mining, web-scraping
- Language: Python
- Homepage:
- Size: 2.59 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Tagalog Dictionary Parser
**A Python script that parses a Tagalog dictionary website and converts it into
several useful formats**
## About
This parser parses the dictionary from
[Pinoy Dictionary](https://tagalog.pinoydictionary.com/) in HTML format and
outputs it to [JSON format](output/tgl_dictionary.json),
[frequency list](output/tgl_freqlist.csv), and
[word list](output/tgl_wordlist.txt).
## Output
> 40,064 words collected (as
> of 08/09/2024)
| Resource | Format | Link |
| -------------- | ------ | -------------------------------------------------------- |
| Dictionary | json | [output/tgl_dictionary.json](output/tgl_dictionary.json) |
| Frequency list | csv | [output/tgl_freqlist.csv](output/tgl_freqlist.csv) |
| Word list | txt | [output/tgl_wordlist.txt](output/tgl_wordlist.txt) |
### JSON Dictionary
The JSON dictionary is structured as a list of words and its corresponding list
of attributes. The attributes include part of speech, definition, etymology,
classifications, synonyms, antonyms, example sentences, inflections, and
sources. The entries are sorted alphabetically.
```json
[
{
"word": "The word itself",
"attributes": [
{
"pos": "Simplified arts of speech",
"definition": "The definition",
"origin": "The etymology",
"classification": "Any classification",
"similar": ["List of synonyms"],
"opposite": ["List of antonyms"],
"examples": ["List of example sentences that use the word"],
"inflections": ["List of inflected forms"],
"sources": ["List of sources"]
}
]
}
]
```
### Frequency list
The frequency list is structured as a list of words and its corresponding
frequency value derived from the
[Leipzig Corpora Collection Dataset (2021 Wikipedia 100k corpus)](https://wortschatz.uni-leipzig.de/en/download/Tagalog).
The list is sorted from highest to lowest frequency value.
```csv
ng,134442
sa,127336
ang,106986
```
### Word list
The word list is simply the list of words sorted alphabetically.