{"id":19152514,"url":"https://github.com/gesiscss/wikipedia_references","last_synced_at":"2026-06-25T10:30:59.639Z","repository":{"id":104686309,"uuid":"237021351","full_name":"gesiscss/wikipedia_references","owner":"gesiscss","description":null,"archived":false,"fork":false,"pushed_at":"2020-07-29T00:22:52.000Z","size":101,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":11,"default_branch":"master","last_synced_at":"2025-02-22T21:15:09.382Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/gesiscss.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-01-29T15:52:18.000Z","updated_at":"2023-08-20T19:36:51.000Z","dependencies_parsed_at":null,"dependency_job_id":"f375f5a0-b777-492a-ae90-d3eca82bb7be","html_url":"https://github.com/gesiscss/wikipedia_references","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/gesiscss/wikipedia_references","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2Fwikipedia_references","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2Fwikipedia_references/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2Fwikipedia_references/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2Fwikipedia_references/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/gesiscss","download_url":"https://codeload.github.com/gesiscss/wikipedia_references/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/gesiscss%2Fwikipedia_references/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34771660,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-25T02:00:05.521Z","response_time":101,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-09T08:18:11.280Z","updated_at":"2026-06-25T10:30:59.582Z","avatar_url":"https://github.com/gesiscss.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# wikipedia_references\n\n[![Binder](https://notebooks.gesis.org/binder/badge_logo.svg)](https://notebooks.gesis.org/binder/v2/gh/gesiscss/wikipedia_references/master)\n\nThis examples shows how to process data [1]. To extract document identifiers (DOI, PubMedID, PMC, ISBN, ISSN, ArXiv ID) we used modified version of regular expresions proposed by Halfaker et al. [2].  \n\nThe dataset consists of json files where article_id is used as file name.\n\nEach file is represented as list of “References”. Each references is a dictionary with the following keys:\n* \"first_rev_id\" type: Integer, first revision where the reference was inserted (the same value is represented in “ins” as the first element of the list and in \"rev_id\" of the first element in the \"change_sequence\")\n* \"first_hash_id\" type: String, hash value of the first version of token_id (WikiWho) list of the reference (the same value is represented as \"hash_id\" of the first element in the \"change_sequence\")\n* \"first_editor_id\"  type: String, user_id or IP address of the first revision where the reference was inserted (the same value is represented as \"editor_id\" of the first element in the \"change_sequence\" \n* \"deleted\" type: Boolean, indicator if the reference exists in the last available revision\n* \"ins\" type: List of Integers, list of revisions where reference was inserted (includes the first revision mentioned as \"first_rev_id\")\n* \"ins_editor\" type: List of Strings, list of user_id or IP addresses of editors where reference was inserted (includes the first user mentioned as \"first_editor_id\")\n* \"del\" type: List of Integers, list of revisions where reference was deleted from the article or reference was modified in a way that less than 25% of tokens remained, \n* \"del_editor“ type: List of Strings, list of user_id or IP addresses of editors where reference was deleted or reference was modified in a way that less than 25% of tokens remained \n* \"modif\" type: List of Integers, list of revisions where reference was modified, or reinserted with modification\n* \"hashes\": type: List of Strings, list of hash values of all versions of references \n* \"first_rev_time\": type: datetime, time stamp when the reference was created (the same value is represented in \"ins_time” as the first element of the list and in \"time\" of the first element in the \"change_sequence\")\n* \"ins_time\" type: List of datetime, list of time stamps when reference was inserted or reinserted\n* \"del_time\" type: List of datetime, list of time stamps when reference was deleted \n* \"change_sequence\" type: List of Dictionaries, with information about tokens, editors and revisions where reference was modified (the first element represent the first revision where reference was inserted), where:\n  * \"hash_id\" type: String, hash value of the token_id (WikiWho) list of the reference version\n  * \"rev_id\" type: Integer, revision number of the particular version of the reference\n  * \"editor_id\" type: String, user_id or IP address of the revision editor\n  * \"time\" type: datetime, time stamp when of this particular version of the reference\n  * \"tokens\" type: List of Strings, ordered list of tokens (created by WikiWho) that represents the particular version of the reference (the list has the same length as \"token_editors\")\n  * \"token_editors\" type: List of Strings, ordered list of user_ids or IP addresses of editors that were first who added the corresponding token (see \"tokens\") to Wikipedia article \n\n\n[1] Zagovora, O., Ulloa, R., Weller, K., \u0026 Flöck, F. (2017). Edit Histories of References Dataset for the English Wikipedia [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3964990\n\n[2] https://github.com/halfak/Extract-scholarly-article-citations-from-Wikipedia \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgesiscss%2Fwikipedia_references","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgesiscss%2Fwikipedia_references","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgesiscss%2Fwikipedia_references/lists"}