{"id":41847717,"url":"https://github.com/camel-lab/hierarchicalarabicdialectid","last_synced_at":"2026-01-25T10:04:44.025Z","repository":{"id":68152482,"uuid":"485154334","full_name":"CAMeL-Lab/HierarchicalArabicDialectID","owner":"CAMeL-Lab","description":null,"archived":false,"fork":false,"pushed_at":"2023-03-31T13:58:05.000Z","size":69,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-09-09T22:06:30.165Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CAMeL-Lab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2022-04-24T22:24:57.000Z","updated_at":"2022-10-27T16:46:30.000Z","dependencies_parsed_at":"2025-09-09T20:33:35.851Z","dependency_job_id":"ad51abb5-faea-44a8-bb40-181dadab0de6","html_url":"https://github.com/CAMeL-Lab/HierarchicalArabicDialectID","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/CAMeL-Lab/HierarchicalArabicDialectID","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CAMeL-Lab%2FHierarchicalArabicDialectID","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CAMeL-Lab%2FHierarchicalArabicDialectID/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CAMeL-Lab%2FHierarchicalArabicDialectID/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CAMeL-Lab%2FHierarchicalArabicDialectID/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CAMeL-Lab","download_url":"https://codeload.github.com/CAMeL-Lab/HierarchicalArabicDialectID/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CAMeL-Lab%2FHierarchicalArabicDialectID/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28751103,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-25T09:58:17.166Z","status":"ssl_error","status_checked_at":"2026-01-25T09:55:56.104Z","response_time":113,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-01-25T10:04:43.960Z","updated_at":"2026-01-25T10:04:44.016Z","avatar_url":"https://github.com/CAMeL-Lab.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Aggregating Hierarchical Dialectal Data for Arabic Dialect  Classification\n\nThis repo contains code for the experiments presented in the paper: [Aggregating Hierarchical Dialectal Data for Arabic Dialect Classification (Baimukan et al., 2022)]().\n\n## Requirements\n\nThis code was written for python\u003e=3.7. You will also need few additional packages. Here's how you can set up the environment using conda (assuming you have conda and cuda installed):\n\n```bash\ngit clone https://github.com/CAMeL-Lab/HierarchicalArabicDialectID.git\ncd HierarchicalArabicDialectID\n\nconda create -n HierarchicalArabicDialectID python=3.7\nconda activate HierarchicalArabicDialectID\n\npip install -r requirements.txt\n\n\n```\n\n## HierarchicalArabicDialectID LMs\n\nOur Arabic Dialectal Language Models can be found [here](https://drive.google.com/drive/folders/1-_uZnl8LamZO9RPYguJJOywJTvJtWUyg?usp=sharing)\n\n\n## Classification\n\nThe code we use for classificatioin extends on [CAMeL Tools](https://github.com/CAMeL-Lab/camel_tools) [(Obeid et al. (2020)](https://aclanthology.org/2020.lrec-1.868v2.pdf), which rebuilt the model by [Salameh et al. (2018)](https://aclanthology.org/C18-1113/).\nIn order to run the classification experiments using the aggregragated LMs in this repo and Baimukan et al. (2022)'s model, use the following commands:\n\n```bash\ncd classification\npython run_classifier.py\n```\n\n## Data Preprocessing\n\nIn order to extract certain data sets you can use the notebooks inside `data_preprocess` sub-folder and `data_process.py` module for data extraction in standard format and  `standardize_label.py` to standardize the hierarchical labels\n\n\n## Citation:\n\nIf you find any of the this work useful, please cite [our paper](https://aclanthology.org/2022.lrec-1.489.pdf):\n```bibtex\n@inproceedings{baimukan-etal-2022-aggregating,\n    title = \"Aggregating Hierarchical Dialectal Data for Arabic Dialect  Classification\",\n    author = \" Baimukan, Nurpeiis  and\n      Habash, Nizar and \n      Bouamor, Houda\",\n    booktitle = \"Proceedings of the Language Resources and Evaluation Conference (LREC)\",\n    month = june,\n    year = \"2022\",\n    address = \"Marseille, France\",\n    publisher = \"The European Language Resources Association\",\n    abstract = \"Arabic is a collection of dialectal variants that are historically related but significantly different. These differences can be seen across regions, countries, and even cities in the same countries.  Previous work on Arabic Dialect Processing tasks has focused mainly on improving their performance at a particular dialect level (i.e. region, country, and/or city) using dialect-specific resources. In this paper, we present the first effort aiming at defining a standard unified hierarchical schema for dialectal Arabic labeling. This schema could be used to facilitate the use of these datasets in a joint manner. We explore fine-grained Classification of Arabic Dialects using the aggregated dialectal data from different levels and different sources.\",\n}\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcamel-lab%2Fhierarchicalarabicdialectid","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcamel-lab%2Fhierarchicalarabicdialectid","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcamel-lab%2Fhierarchicalarabicdialectid/lists"}