{"id":38291313,"url":"https://github.com/httpreserve/httpreserve","last_synced_at":"2026-01-17T02:10:24.017Z","repository":{"id":57524243,"uuid":"84752125","full_name":"httpreserve/httpreserve","owner":"httpreserve","description":"Digital Preservation of HTTP in documentary heritage.","archived":false,"fork":false,"pushed_at":"2023-05-26T18:07:50.000Z","size":1343,"stargazers_count":21,"open_issues_count":10,"forks_count":3,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-06-20T16:36:36.970Z","etag":null,"topics":["archives","code4lib","digipres","digital-repositories","digitalpreservation","documentary-heritage","internetarchive","wayback","waybackmachine","webarchiving"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/httpreserve.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"ko_fi":"https://ko-fi.com/beet_keeper"}},"created_at":"2017-03-12T19:41:52.000Z","updated_at":"2024-06-17T21:10:29.000Z","dependencies_parsed_at":"2024-06-20T16:31:32.605Z","dependency_job_id":null,"html_url":"https://github.com/httpreserve/httpreserve","commit_stats":null,"previous_names":["exponential-decay/httpreserve"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/httpreserve/httpreserve","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/httpreserve%2Fhttpreserve","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/httpreserve%2Fhttpreserve/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/httpreserve%2Fhttpreserve/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/httpreserve%2Fhttpreserve/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/httpreserve","download_url":"https://codeload.github.com/httpreserve/httpreserve/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/httpreserve%2Fhttpreserve/sbom","scorecard":{"id":388392,"data":{"date":"2025-08-11","repo":{"name":"github.com/httpreserve/httpreserve","commit":"9e3e83caa93f12d005ec0e8be5e641712be0abb0"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3,"checks":[{"name":"Code-Review","score":0,"reason":"Found 0/30 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: GNU General Public License v3.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'main'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 2 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-18T17:13:28.515Z","repository_id":57524243,"created_at":"2025-08-18T17:13:28.515Z","updated_at":"2025-08-18T17:13:28.515Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28492057,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-17T00:50:05.742Z","status":"online","status_checked_at":"2026-01-17T02:00:07.808Z","response_time":85,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["archives","code4lib","digipres","digital-repositories","digitalpreservation","documentary-heritage","internetarchive","wayback","waybackmachine","webarchiving"],"created_at":"2026-01-17T02:10:21.208Z","updated_at":"2026-01-17T02:10:23.998Z","avatar_url":"https://github.com/httpreserve.png","language":"Go","funding_links":["https://ko-fi.com/https://ko-fi.com/beet_keeper"],"categories":[],"sub_categories":[],"readme":"\u003cdiv\u003e\n\u003cp align=\"center\"\u003e\n\u003cimg height=\"300px\" width=\"300px\" id=\"logo\" src=\"https://github.com/httpreserve/httpreserve/raw/main/src/images/httpreserve-logo.png\" alt=\"httpreserve\"/\u003e\n\u003c/p\u003e\n\u003c/div\u003e\n\n# httpreserve\n\n[![GoDoc](https://godoc.org/github.com/httpreserve/httpreserve?status.svg)](https://godoc.org/github.com/httpreserve/httpreserve)\n[![Go Report Card](https://goreportcard.com/badge/github.com/httpreserve/httpreserve)](https://goreportcard.com/report/github.com/httpreserve/httpreserve)\n\nA tool to check the status of a weblink and also see whether it is archived\nin the [Internet Archive](https://archive.org/).\n\nTry it out here [httpreserve.info](http://httpreserve.info)\n\n## Default Server\n\nThe library comes with a default server mode that can be configured for\nPOST and GET requests. POST by default. Default port is :2040 but this can\nalso be selected at runtime.\n\n![Image of the in-built HTTPPreserve server](src/images/defaultserver.png)\n\nThe default server can also be stood up as a web service. The API is\ndocumented below.\n\n## Client\n\nThe httpreserve linstat client is a separate application offering simple access\nto httpreserve functionality through the command line. See [linkstat][ls-1]\n\n[ls-1]: https://github.com/httpreserve/linkstat\n\nThe client application is a work in progress. Stay tuned for more\ninformation about its capabilities.\n\n## API\n\nPrimary entry point when the server is running:\n\n*http://{httpreserve-ip-address}:{port}/httpreserve*\n\nor\n\n*http://{httpreserve-ip-address}:{port}/save*\n\n**GET** example:\n\n* Return JSON struct with information about the service you requested:\n\n    [http://\u003ci\u003e{httpreserve-ip-address}:{port}\u003c/i\u003e/httpreserve?url=http://www.google.com\u0026filename=filename.txt][example-1]\n\n[example-1]: http://httpreserve.info/httpreserve?url=http://www.google.com\u0026filename=filename.txt\n\n* Manage a save request to the internet archive and return HTTPreserve struct:\n\n    [http://\u003ci\u003e{httpreserve-ip-address}:{port}\u003c/i\u003e/save?url=http://www.google.com\u0026filename=filename.txt][example-2]\n\n[example-2]: http://httpreserve.info/httpreserve?url=http://www.google.com\u0026filename=filename.txt\n\n**POST** example:\n\n    Same access point, but encode url and filename in a \u003ci\u003eapplication/x-www-form-urlencoded\u003c/i\u003e form.\n\n**OPTIONS** example:\n\n    `curl -X OPTIONS http://httpreserve.info | less`\n\n**RETURN** value:\n\n'application/json' struct to work with, e.g.\n\n```json\n        {\n        \"AnalysisVersionNumber\": \"0.0.15\",\n        \"AnalysisVersionText\": \"exponentialDK-httpreserve/0.0.15\",\n        \"SimpleRequestVersion\": \"httpreserve-simplerequest/0.0.4\",\n        \"Link\": \"http://example.com/\",\n        \"Title\": \"example domain\",\n        \"ContentType\": \"text/html; charset=UTF-8\",\n        \"ResponseCode\": 206,\n        \"ResponseText\": \"Partial Content\",\n        \"SourceURL\": \"http://example.com/\",\n        \"ScreenShot\": \"snapshots are not currently enabled\",\n        \"InternetArchiveLinkEarliest\": \"http://web.archive.org/web/20020120142510/http://example.com/\",\n        \"InternetArchiveEarliestDate\": \"2002-01-20 14:25:10 +0000 UTC\",\n        \"InternetArchiveLinkLatest\": \"http://web.archive.org/web/20230526145524/https://example.com/\",\n        \"InternetArchiveLatestDate\": \"2023-05-26 14:55:24 +0000 UTC\",\n        \"InternetArchiveSaveLink\": \"http://web.archive.org/save/http://example.com/\",\n        \"InternetArchiveResponseCode\": 302,\n        \"InternetArchiveResponseText\": \"Found\",\n        \"RobustLinkEarliest\": \"\u003ca href='http://web.archive.org/web/20020120142510/http://example.com/' data-originalurl='http://example.com/' data-versiondate='2002-01-20'\u003eHTTPreserve Robust Link - simply replace this text!!\u003c/a\u003e\",\n        \"RobustLinkLatest\": \"\u003ca href='http://web.archive.org/web/20230526145524/https://example.com/' data-originalurl='http://example.com/' data-versiondate='2023-05-26'\u003eHTTPreserve Robust Link - simply replace this text!!\u003c/a\u003e\",\n        \"PWID\": \"urn:pwid:archive.org:2023-05-26T14:55:24Z:page:http://example.com/\",\n        \"Archived\": true,\n        \"Error\": false,\n        \"ErrorMessage\": \"\",\n        \"StatsCreationTime\": \"883.557598ms\"\n        }\n```\n\n## Archiving Weblinks\n\n* [Find and Connect Project:][laurent-1] Nicola Laurent on the impact of broken links.\n* [Binary Trees? Automatically Identifying the links between born digital records:][spencer-1] I write about hyperlinks as a public record in own right when submitted as part of a documentary heritage.\n\n## Robust links and Persistent Web Identifiers\n\nHTTPreserve tries to promote the use of emerging standards such as Mementoweb's\nRobust Links and the Royal Danish Library's Persistent Web-Identifiers (PWIDs).\n\nMore information about those can be found at the links below:\n\n* [Robust Links][robust-1]\n* [PWIDs][pwid-1]\n\n## License\n\nGNU General Public License Version 3. [Full Text](LICENSE)\n\n[laurent-1]: http://www.findandconnectwrblog.info/2016/11/broken-links-broken-trust/\n[spencer-1]: https://www.youtube.com/watch?v=Ked9GRmKlRw\n[robust-1]: https://robustlinks.mementoweb.org/spec/\n[pwid-1]: https://www.iana.org/assignments/urn-formal/pwid\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhttpreserve%2Fhttpreserve","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhttpreserve%2Fhttpreserve","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhttpreserve%2Fhttpreserve/lists"}