{"id":13554884,"url":"https://github.com/machawk1/warcreate","last_synced_at":"2025-04-10T02:23:18.955Z","repository":{"id":7553352,"uuid":"8906459","full_name":"machawk1/warcreate","owner":"machawk1","description":"Chrome extension to \"Create WARC files from any webpage\"","archived":false,"fork":false,"pushed_at":"2023-12-06T16:50:29.000Z","size":2335,"stargazers_count":220,"open_issues_count":58,"forks_count":13,"subscribers_count":16,"default_branch":"main","last_synced_at":"2025-04-03T00:05:50.078Z","etag":null,"topics":["chrome-extension","warc","web-archiving"],"latest_commit_sha":null,"homepage":"https://warcreate.com","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/machawk1.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2013-03-20T14:42:04.000Z","updated_at":"2025-04-01T22:15:11.000Z","dependencies_parsed_at":"2024-08-01T12:37:01.946Z","dependency_job_id":null,"html_url":"https://github.com/machawk1/warcreate","commit_stats":{"total_commits":164,"total_committers":6,"mean_commits":"27.333333333333332","dds":0.4207317073170732,"last_synced_commit":"9a890b0d3aff3d4fbd3d44fa30ddb13a0f7044f5"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/machawk1%2Fwarcreate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/machawk1%2Fwarcreate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/machawk1%2Fwarcreate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/machawk1%2Fwarcreate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/machawk1","download_url":"https://codeload.github.com/machawk1/warcreate/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248143330,"owners_count":21054758,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chrome-extension","warc","web-archiving"],"created_at":"2024-08-01T12:02:57.027Z","updated_at":"2025-04-10T02:23:18.934Z","avatar_url":"https://github.com/machawk1.png","language":"JavaScript","funding_links":[],"categories":["JavaScript","chrome-extension"],"sub_categories":[],"readme":"\u003ch2 align=\"center\"\u003e\n \u003ca href=\"https://github.com/machawk1/mink\"\u003e\u003cimg src=\"https://cdn.rawgit.com/machawk1/warcreate/master/icons/icon-128.png\" alt=\"WARCreate logo\" /\u003e\u003c/a\u003e\u003cbr /\u003eWARCreate\u003c/h2\u003e\n \u003cp align=\"center\" style=\"font-weight: normal;\"\u003e\u003cem\u003e\"Create \u003ca href=\"http://www.iso.org/iso/catalogue_detail.htm?csnumber=44717\"\u003eWARC\u003c/a\u003e files from any webpage\"\u003c/em\u003e\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"http://standardjs.com/\"\u003e\u003cimg src=\"https://img.shields.io/badge/code%20style-standard-brightgreen.svg\" /\u003e\u003c/a\u003e\n  \u003cbr /\u003e\u003ca href=\"https://chrome.google.com/webstore/detail/warcreate/kenncghfghgolcbmckhiljgaabnpcaaa?hl=en\u0026gl=US\" \u003e\u003cimg src=\"/docs/chromestore.png\" width=\"200\" /\u003e\u003c/a\u003e\n\u003c/p\u003e\n\nWARCreate is a Google Chrome extension with an aim to be able to \"Create [WARC](http://www.iso.org/iso/catalogue_detail.htm?csnumber=44717) files from any webpage\".\n\nWith WARCs normally being limited to be generated by Internet Archive's [Heritrix](https://github.com/internetarchive/heritrix3) Archival Crawler, providing another means of generating these files from webpages \nopens the door to\n+ Preserving content not accessible to crawlers (e.g., deep web contents)\n+ Circumventing the complication and overhead needed to setup a Heritrix instance by an end-user\n+ Allowing a webpage to be interacted with (e.g., Facebook comments unrolled) prior to preservation, ensuring content that might not be initially present in a page is available to be captured.\n\n...among many other use cases.\n\nWARCreate is currently in active development though has gone through various release and retraction periods due to changes in the Google Chrome extension API and rules controlling extension distribution.\n\nThe original idea and prototype was [published](http://dl.acm.org/citation.cfm?id=2232930) in the Joint Conference on Digital Libraries 2012 (JCDL '12) Proceedings.\n\n## Install ##\n\nThe latest stable binary can be [downloaded from the Chrome Web Store](https://chrome.google.com/webstore/detail/warcreate/kenncghfghgolcbmckhiljgaabnpcaaa?hl=en\u0026gl=US).\n\n### Citing Project\n\nA publication related to this project appeared in the proceedings of JCDL 2012 ([Read the PDF](https://matkelly.com/papers/2012_jcdl_warcreate.pdf)). Please cite it as below:\n\n\u003e Mat Kelly and Michele C. Weigle. __WARCreate - Create Wayback-Consumable WARC Files from Any Webpage__. In _Proceedings of the ACM/IEEE Joint Conference on Digital Libraries (JCDL)_, pages 437–438, Washington, DC, June 2012.\n\n```bib\n@INPROCEEDINGS{warcreate-jcdl2012,\n  AUTHOR    = {Mat Kelly and\n               Michele C. Weigle},\n  TITLE     = {{WARCreate} - Create Wayback-Consumable WARC Files from Any Webpage},\n  BOOKTITLE = {Proceedings of the ACM/IEEE Joint Conference on Digital Libraries (JCDL)},\n  PAGES     = {437--438},\n  MONTH     = {June},\n  YEAR      = {2012},\n  ADDRESS   = {Washington, DC},\n  DOI       = {10.1145/2232817.2232930}\n}\n```\n\n## Contact ##\nWARCreate is a project of the \u003ca href=\"http://ws-dl.cs.odu.edu\"\u003eWeb Science and Digital Libraries (WS-DL) research group at Old Dominion University (ODU)\u003c/a\u003e, created by Mat Kelly.\n\nFor support e-mail warcreate@matkelly.com or tweet to us at \u003ca href=\"https://twitter.com/machawk1\"\u003e@machawk1\u003c/a\u003e and/or \u003ca href=\"https://twitter.com/WebSciDL\"\u003e@WebSciDL\u003c/a\u003e.\n\n## License ##\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmachawk1%2Fwarcreate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmachawk1%2Fwarcreate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmachawk1%2Fwarcreate/lists"}