{"id":19152484,"url":"https://github.com/gesiscss/tubecleanr","last_synced_at":"2026-05-17T10:36:26.501Z","repository":{"id":223152954,"uuid":"753794146","full_name":"gesiscss/tubecleanR","owner":"gesiscss","description":"(Mini) R package for preprocessing YouTube comment data collected with tuber or vosonSML","archived":false,"fork":false,"pushed_at":"2025-11-28T13:50:10.000Z","size":7766,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":6,"default_branch":"main","last_synced_at":"2026-04-13T10:05:15.523Z","etag":null,"topics":["preprocessing","r","tuber","vosonsml","youtube"],"latest_commit_sha":null,"homepage":"https://gesiscss.github.io/tubecleanR/","language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gesiscss.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-02-06T20:01:36.000Z","updated_at":"2025-11-28T13:47:44.000Z","dependencies_parsed_at":"2025-09-05T15:47:42.675Z","dependency_job_id":"c5cd71f6-28c8-4619-a8af-bb6b04c2ea37","html_url":"https://github.com/gesiscss/tubecleanR","commit_stats":null,"previous_names":["gesiscss/tubecleanr"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/gesiscss/tubecleanR","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2FtubecleanR","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2FtubecleanR/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2FtubecleanR/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2FtubecleanR/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gesiscss","download_url":"https://codeload.github.com/gesiscss/tubecleanR/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2FtubecleanR/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33135105,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-17T09:28:26.183Z","status":"ssl_error","status_checked_at":"2026-05-17T09:27:52.702Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["preprocessing","r","tuber","vosonsml","youtube"],"created_at":"2024-11-09T08:18:04.152Z","updated_at":"2026-05-17T10:36:26.495Z","avatar_url":"https://github.com/gesiscss.png","language":"R","funding_links":[],"categories":[],"sub_categories":[],"readme":"# tubecleanR\n\u003cimg src=\"man/figures/tubecleanR_stickr.png\" align=\"right\" alt=\"tubecleanR Sticker\" width=\"120\"\u003e\n\nThis is a mini `R` package for cleaning and preprocess *YouTube* comment data collected with the `R` packages [tuber](https://github.com/gojiplus/tuber) or [vosonSML](https://github.com/vosonlab/vosonSML).\nThe package is a collection of functions that were developed during several workshops on collecting and analyzing *YouTube* data at [GESIS - Leibniz Institute for the Social Sciences](https://www.gesis.org/home). The main function of the package is `parse_yt_comments()` which takes a dataframe containing *YouTube* comments collected with `tuber` or `vosonSML` as input and outputs a processed dataframe in which URLs/links, video timestamps user mentions, emoticons, and emoji have been extracted from the comments into separate columns. In addition to this, the function creates a column containing textual descriptions of the emoji, and another one containing a cleaned version of the comment in which the elements listed before as well as numbers and punctuation have been removed.\n\n**Please note**: The functions in this package are heavily dependent on the structure of the data exports from `tuber` and `vosonSML`, and, by extension, the structure of the *YouTube* API. You can find an introduction to the *YouTube Data API* in the [*GESIS Guide on Digital Behavioral Data* on \"How to Collect Data with the YouTube Data API\"](https://www.gesis.org/fileadmin/admin/Dateikatalog/pdf/guides/13_Kohne_et_al_How_to_YouTube.pdf). \n\nIf you are interested in becoming a maintainer of this package, feel free to contact us.\n \n## 1) Installation\n\n```R\n # GitHub version\n library(remotes)\n remotes::install_github(\"gesiscss/tubecleanR\")\n```\n \n## 2) Demo data\n\nWe have created some simulated *YouTube* comment data in the `tuber` and `vosonSML` formats that is included in this package.\n\n```R\n# Attaching package\nlibrary(tubecleanR)\n\n# Checking example comments bundled with the package\nView(tuberComments)\nView(vosonComments)\n\n# Parsing comments\ntuber_parsed \u003c- parse_yt_comments(tuberComments)\nvoson_parsed \u003c- parse_yt_comments(vosonComments)\n\n# Checking parsed versions of example comments\nView(tuber_parsed)\nView(Voson_parsed)\n```\n \n## 3) Using your own data\n\nThe `parse_yt_comments()` function is meant to be used for *YouTube* comment data collected with the `get_all_comments()` function from `tuber` or the `Collect()` function from `vosonSML`. Both of those require access credentials for the *YouTube API*. Check the documentation of those two packages for further details.\n\nIf you want to learn more about getting access to the *YouTube* API, collecting comment (and other) data from the API using `R`, and processing and exploring the resulting data, you can also check out the materials from our [workshop](https://github.com/jobreu/youtube-workshop-gesis-2023).\n\n## 4) Citation\nIf you are using this package in your research, please cite it as follows:\n\n```R\ncitation(\"tubecleanR\")\n```\n\n```R\nTo cite package ‘tubecleanR’ in publications use:\n\n  Kohne, J., \u0026 Breuer, J. (2024). tubecleanR: Parsing and Preprocessing YouTube Comment\n  Data. R package version 0.1.0. \u003chttps://gesiscss.github.io/tubecleanR/\u003e.\n\nA BibTeX entry for LaTeX users is\n\n  @Manual{,\n    title = {tubecleanR: Parsing and Preprocessing YouTube Comment Data},\n    author = {Julian Kohne and Johannes Breuer},\n    year = {2024},\n    note = {R package version 0.1.0},\n    url = {https://gesiscss.github.io/tubecleanR/},\n  }\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgesiscss%2Ftubecleanr","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgesiscss%2Ftubecleanr","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgesiscss%2Ftubecleanr/lists"}