{"id":24480816,"url":"https://github.com/dsfsi/embedding-eval-data","last_synced_at":"2026-02-17T01:02:01.988Z","repository":{"id":98757001,"uuid":"411973433","full_name":"dsfsi/embedding-eval-data","owner":"dsfsi","description":"Embedding Evaluation Data for South African Languages","archived":false,"fork":false,"pushed_at":"2023-10-26T07:24:15.000Z","size":9,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-06T00:55:57.094Z","etag":null,"topics":["africa","dsfsi-datasets","low-resource-languages","machine-learning","nlp","nlproc","south-africa"],"latest_commit_sha":null,"homepage":"https://zenodo.org/record/5673974","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dsfsi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-30T07:54:33.000Z","updated_at":"2023-10-25T13:35:57.000Z","dependencies_parsed_at":"2023-05-25T04:45:30.652Z","dependency_job_id":"b6947d87-c632-497e-9d48-7082d23d8e3b","html_url":"https://github.com/dsfsi/embedding-eval-data","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dsfsi/embedding-eval-data","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dsfsi%2Fembedding-eval-data","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dsfsi%2Fembedding-eval-data/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dsfsi%2Fembedding-eval-data/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dsfsi%2Fembedding-eval-data/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dsfsi","download_url":"https://codeload.github.com/dsfsi/embedding-eval-data/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dsfsi%2Fembedding-eval-data/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29528240,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-17T00:57:22.232Z","status":"ssl_error","status_checked_at":"2026-02-17T00:54:25.811Z","response_time":115,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["africa","dsfsi-datasets","low-resource-languages","machine-learning","nlp","nlproc","south-africa"],"created_at":"2025-01-21T11:17:26.762Z","updated_at":"2026-02-17T01:02:01.947Z","avatar_url":"https://github.com/dsfsi.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# Embedding Evaluation Data for South African Languages\n\n[![arXiv](https://img.shields.io/badge/arXiv-2111.06230-b31b1b.svg)](https://arxiv.org/abs/2111.06230)\n\nGive Feedback 📑: [DSFSI Resource Feedback Form](https://docs.google.com/forms/d/e/1FAIpQLSf7S36dyAUPx2egmXbFpnTBuzoRulhL5Elu-N1eoMhaO7v10w/formResponse)\n\n## Dataset Information\n\nThe datasets(Simlex and WordSim) contain pairs of Setswana and Sepedi words that have been assigned similarity ratings by humans to measure semantic relatedness. The word-pairs(Simlex and WordSim) are manually translated from English to Setswana and Sepedi. The evaluation task aims to find the degree of correlation between the scores provided by the model and the human rating, the score of the model is collected by computing the cosine similarity of corresponding vectors for word pairs.\n\n## Online Repository link\n\n* [Zenodo Data Repository](https://zenodo.org/record/5673974) - Link to the data repository.\n\n## Authors\n\n* **Vukosi Marivate** - [@vukosi](https://twitter.com/vukosi)\n* **Valencia Wagner**\n* **Mack Makgatho**\n* **Tshephisho Sefara**\n\nSee also the list of [contributors](https://github.com/dsfsi/embedding-eval-data//contributors) who participated in this project.\n\n## Citing the dataset\n\nTo appear in conference proceedings\n\n\u003e@article{Makgatho_Marivate_Sefara_Wagner_2022, title={Training Cross-Lingual embeddings for Setswana and Sepedi}, \nvolume={3}, \nurl={https://upjournals.up.ac.za/index.php/dhasa/article/view/3822}, \nDOI={10.55492/dhasa.v3i03.3822}, \nnumber={03},\njournal={Journal of the Digital Humanities Association of Southern Africa },\nauthor={Makgatho, Mack and Marivate, Vukosi and Sefara, Tshephisho and Wagner, Valencia}, \nyear={2022}, \nmonth={Feb.}}\n\n## License\nDataset is licensed under CC-BY-4.0\nThis project is licensed under the MIT License - see the [LICENSE.md](LICENSE.md) file for details\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdsfsi%2Fembedding-eval-data","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdsfsi%2Fembedding-eval-data","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdsfsi%2Fembedding-eval-data/lists"}