{"id":13684256,"url":"https://github.com/franciellevargas/HateBR","last_synced_at":"2025-04-30T20:33:39.266Z","repository":{"id":45840056,"uuid":"352094999","full_name":"franciellevargas/HateBR","owner":"franciellevargas","description":"HateBR is the first large-scale expert annotated dataset of Brazilian Instagram comments for hate speech and offensive language detection on the web and social media.","archived":false,"fork":false,"pushed_at":"2024-10-15T23:57:00.000Z","size":2985,"stargazers_count":26,"open_issues_count":1,"forks_count":5,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-10-17T11:09:03.361Z","etag":null,"topics":["brazilian-portuguese","dataset","hatespeech-detection","machine-learning","natural-language-processing","text-classification"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/franciellevargas.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-03-27T14:34:49.000Z","updated_at":"2024-10-15T23:57:04.000Z","dependencies_parsed_at":"2024-01-07T12:37:02.023Z","dependency_job_id":"8031bfe0-4e7a-4ab6-b054-9ae20c7df847","html_url":"https://github.com/franciellevargas/HateBR","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/franciellevargas%2FHateBR","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/franciellevargas%2FHateBR/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/franciellevargas%2FHateBR/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/franciellevargas%2FHateBR/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/franciellevargas","download_url":"https://codeload.github.com/franciellevargas/HateBR/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224224786,"owners_count":17276428,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["brazilian-portuguese","dataset","hatespeech-detection","machine-learning","natural-language-processing","text-classification"],"created_at":"2024-08-02T14:00:31.569Z","updated_at":"2025-04-30T20:33:39.258Z","avatar_url":"https://github.com/franciellevargas.png","language":null,"funding_links":[],"categories":["Datasets"],"sub_categories":[],"readme":"[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.7681302.svg)](https://doi.org/10.5281/zenodo.10794024)\n\n\u003ch2 align=\"center\"\u003e HateBR - A Benchmark Dataset for Offensive Language and Hate Speech in Brazilian Portuguese \u003c/h2\u003e  \n\n\u003c/br\u003e\n\u003cp align=\"justify\"\u003e HateBR is the first large-scale expert annotated dataset of Brazilian Instagram comments for abusive language detection on the web and social media. The HateBR was collected from Brazilian Instagram comments of politicians and manually annotated by specialists. It is composed of 7,000 documents annotated according to three different layers: a binary classification (offensive versus non-offensive comments), offensiveness-level (highly, moderately, and slightly offensive messages), and hate speech targets. Each comment was annotated by three different expert annotators and achieved high inter-annotator agreement. Furthermore, baseline experiments were implemented outperforming the current literature dataset baselines for the Portuguese language. We hope that the proposed expert annotated dataset may foster research on hate speech detection in the Natural Language Processing area. \u003c/p\u003e\n\n\u003c/br\u003e\n\u003ch3 align=\"center\"\u003e***UPDATE***: \u003cu\u003eHateBR\u003c/u\u003e and \u003cu\u003eHateBRXplain\u003c/u\u003e new versions are available\u003c/h3\u003e \n\u003c/br\u003e\n  \n\u003cp align=\"justify\"\u003e This repository contains the corpus and the best models presented in the LREC's paper (see section \"CITING / BIBTEX\"). \n  \nThe following table describes in detail the classes:\n\n### HateBR \n\u003cdiv align=\"center\"\u003e\n\n| class         | label | total  |\n|--------------|-------|--------|\n| offensive    | 1     | 3,500  |\n| non-offensive | 0    | 3,500  |\n| **Total**    |       | **7,000** |\n\n\u003c/div\u003e\n\n### HateBRXplain \n\n\u003cdiv align=\"center\"\u003e\n\n| class         | label | rationales                     | total  |\n|--------------|-------|--------------------------------|--------|\n| offensive    | 1     | human-annotated rationales    | 3,500  |\n| non-offensive | 0    | null                          | 3,500  |\n| **Total**    |       |                                | **7,000** |\n\n\u003c/div\u003e\n\n\n\u003c/br\u003e\n\nIn addition, we also provide baseline machine learning results for both tasks: offensive language and hate speech detection. The best-obtained models are available here in .pkl files. File names are organized as `[classification (offensive or hate)_representation (ngram or tfidf)_algorithms (nb, svm, mlp or lr)]`. For example, the file *offensive_tfidf_svm.pkl* presents the model of offensive detection with tf-idf representation using the support vector machine algorithm.\n\n\u003c/br\u003e\n\n\n\u003ch2 align=\"left\"\u003e CITING / BIBTEX \u003c/h2\u003e\n\n\u003cp align=\"justify\"\u003e\n  @inproceedings{vargas-etal-2022-hatebr,\n    title = \"{H}ate{BR}: A Large Expert Annotated Corpus of {B}razilian {I}nstagram Comments for Offensive Language and Hate Speech Detection\",\n    author = \"Vargas, Francielle  and\n      Carvalho, Isabelle  and\n      Rodrigues de G{\\'o}es, Fabiana  and\n      Pardo, Thiago  and\n      Benevenuto, Fabr{\\'\\i}cio\",\n    booktitle = \"Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022)\",\n    year = \"2022\",\n    address = \"Marseille, France\",\n    publisher = \"European Language Resources Association\",\n    url = \"https://aclanthology.org/2022.lrec-1.777\",\n    pages = \"7174--7183\",\n    }\n\u003c/p\u003e\n\n\u003cbr\u003e\u003c/br\u003e\n\n @article{Vargas_Carvalho_Pardo_Benevenuto_2024, \n author={Vargas, Francielle and Carvalho, Isabelle and Pardo, Thiago A. S. and Benevenuto, Fabrício},\n title={Context-aware and expert data resources for Brazilian Portuguese hate speech detection}, \n DOI={10.1017/nlp.2024.18}, \n journal={Natural Language Processing},  \n year={2024}, \n pages={1–22},\n url={https://www.cambridge.org/core/journals/natural-language-processing/article/contextaware-and-expert-data-resources-for-brazilian-portuguese-hate-speech-detection/7D9019ED5471CD16E320EBED06A6E923#},\n } \n \u003cdiv\u003e\u003c/div\u003e\n\n\u003cbr\u003e\u003c/br\u003e\n\n\u003cp align=\"justify\"\u003e\n@inproceedings{salles-etal-2025-hatebrxplain,\n    title = \"{H}ate{BRX}plain: A Benchmark Dataset with Human-Annotated Rationales for Explainable Hate Speech Detection in {B}razilian {P}ortuguese\",\n    author = \"Salles, Isadora  and\n      Vargas, Francielle  and\n      Benevenuto, Fabr{\\'i}cio\",\n    editor = \"Rambow, Owen  and\n      Wanner, Leo  and\n      Apidianaki, Marianna  and\n      Al-Khalifa, Hend  and\n      Eugenio, Barbara Di  and\n      Schockaert, Steven\",\n    booktitle = \"Proceedings of the 31st International Conference on Computational Linguistics\",\n    month = jan,\n    year = \"2025\",\n    address = \"Abu Dhabi, UAE\",\n    publisher = \"Association for Computational Linguistics\",\n    url = \"https://aclanthology.org/2025.coling-main.446/\",\n    pages = \"6659--6669\",\n}\n\u003c/p\u003e\n\n\u003cbr\u003e\u003c/br\u003e\n\n\u003ch2 align=\"left\"\u003e FUNDING \u003c/h2\u003e\n\n![SSC-logo-300x171](https://github.com/franciellevargas/franciellevargas.github.io/blob/fc03a6672ab2937e413e4508a5061abed4a66098/img/fapesp.jpg)\n\n\u003c/br\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffranciellevargas%2FHateBR","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffranciellevargas%2FHateBR","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffranciellevargas%2FHateBR/lists"}