https://github.com/rexshijaku/albanian-dialect-corpus

The First Ever Albanian Dialect Corpus
https://github.com/rexshijaku/albanian-dialect-corpus

Last synced: 11 days ago
JSON representation

The First Ever Albanian Dialect Corpus

• Host: GitHub
• URL: https://github.com/rexshijaku/albanian-dialect-corpus
• Owner: rexshijaku
• Created: 2023-05-03T10:11:24.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-02-22T22:32:18.000Z (9 months ago)
• Last Synced: 2024-10-16T19:42:11.447Z (about 1 month ago)
• Homepage:
• Size: 5.97 MB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
### The Albanian Dialect Corpus

This repository provides the following information:

 - ``data`` folder: contains three folders which group tweets for each region

 

    - ``al`` folder: tweets posted by users in Albania;

    - ``mk`` folder: tweets posted by users in North Macedonia;

    - ``ks`` folder: tweets posted by users in Kosovo;

     ``Each file in any of these folders represents tweets of a specific user and each line of any file represents a single tweet.`` 

In order to maintain confidentiality and protect user privacy, all identifying information about the user, including their username, has been hidden. This is done to ensure that no personally identifiable information is revealed and to respect the user's right to privacy. Users are represented in this format ``{no}``.txt where ``no`` corresponds to the ordered usernames of the users in their respective folders.

Finally, this corpus was used in our work ``Using Twitter to Collect a Multi-Dialectal Corpus of Albanian using advanced geotagging and dialect modeling`` which is published here  here.