{"id":13464647,"url":"https://github.com/webrecorder/pywb","last_synced_at":"2025-05-14T14:09:06.824Z","repository":{"id":12385047,"uuid":"15037172","full_name":"webrecorder/pywb","owner":"webrecorder","description":"Core Python Web Archiving Toolkit for replay and recording of web archives","archived":false,"fork":false,"pushed_at":"2025-05-02T01:40:39.000Z","size":33227,"stargazers_count":1499,"open_issues_count":171,"forks_count":228,"subscribers_count":60,"default_branch":"main","last_synced_at":"2025-05-06T15:32:42.588Z","etag":null,"topics":["python","pywb","wayback","web-archives","web-archiving"],"latest_commit_sha":null,"homepage":"https://pypi.python.org/pypi/pywb","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/webrecorder.png","metadata":{"files":{"readme":"README.rst","changelog":"CHANGES.rst","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":"webrecorder"}},"created_at":"2013-12-09T03:30:31.000Z","updated_at":"2025-05-05T16:47:01.000Z","dependencies_parsed_at":"2024-04-01T16:28:08.255Z","dependency_job_id":"e12c60a0-4842-4467-be38-10b6e5ddf581","html_url":"https://github.com/webrecorder/pywb","commit_stats":{"total_commits":2177,"total_committers":66,"mean_commits":"32.984848484848484","dds":0.3082223242994947,"last_synced_commit":"83b2113be2c2574ec120ba292006d706e3cc3d53"},"previous_names":["ikreymer/pywb"],"tags_count":65,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/webrecorder%2Fpywb","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/webrecorder%2Fpywb/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/webrecorder%2Fpywb/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/webrecorder%2Fpywb/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/webrecorder","download_url":"https://codeload.github.com/webrecorder/pywb/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253502970,"owners_count":21918540,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["python","pywb","wayback","web-archives","web-archiving"],"created_at":"2024-07-31T14:00:47.969Z","updated_at":"2025-05-14T14:09:06.818Z","avatar_url":"https://github.com/webrecorder.png","language":"JavaScript","readme":"Webrecorder pywb 2.9\n====================\n\n.. image:: https://raw.githubusercontent.com/webrecorder/pywb/main/pywb/static/pywb-logo.png\n\n.. image:: https://github.com/webrecorder/pywb/workflows/CI/badge.svg\n      :target: https://github.com/webrecorder/pywb/actions\n.. image:: https://codecov.io/gh/webrecorder/pywb/branch/main/graph/badge.svg\n      :target: https://codecov.io/gh/webrecorder/pywb\n\nWeb Archiving Tools for All\n---------------------------\n\n`View the full pywb documentation \u003chttps://pywb.readthedocs.org\u003e`_\n\n**pywb** is a Python 3 web archiving toolkit for replaying web archives large and small as accurately as possible.\nThe toolkit now also includes new features for creating high-fidelity web archives.\n\nThis toolset forms the foundation of Webrecorder project, but also provides a generic web archiving toolkit\nthat is used by other web archives, including the traditional \"Wayback Machine\" functionality.\n\n\nNew Features\n^^^^^^^^^^^^\n\nThe 2.x release included a major overhaul of pywb and introduces many new features, including the following:\n\n* Dynamic multi-collection configuration system with no-restart updates.\n\n* New recording capability to create new web archives from the live web or other archives.\n\n* Componentized architecture with standalone Warcserver, Recorder and Rewriter components.\n\n* Support for Memento API aggregation and fallback chains for querying multiple remote and local archival sources.\n\n* HTTP/S Proxy Mode with customizable certificate authority for proxy mode recording and replay.\n\n* Flexible rewriting system with pluggable rewriters for different content-types.\n\n* Standalone, modular `client-side rewriting system (wombat.js) \u003chttps://github.com/webrecorder/wombat\u003e`_ to handle most modern web sites.\n\n* Improved 'calendar' query UI with incremental loading, grouping results by year and month, and updated replay banner.\n\n* Extensible UI customizations system for modifying all aspects of the UI.\n\n* Robust access control system for blocking or excluding URLs, by prefix or by exact match.\n\n* New in 2.6: Access Control embargo and http-header control access settings.\n\n* New in 2.6: Support for localization and multi-language deployment.\n\n* New in 2.7: New banner/calendar UI written in `Vue \u003chttps://vuejs.org/\u003e`_, with interactive timeline and easier theming of colors and logo via ``config.yaml``.\n\n* New in 2.9: Client-side replay is added as an option and can be enabled via ``config.yaml``\n\n\nPlease see the `full documentation \u003chttps://pywb.readthedocs.org\u003e`_ for more detailed info on all these features.\n\n\nInstallation for Deployment\n---------------------------\n\nTo install pywb for usage, you can use:\n\n``pip install pywb``\n\nNote: depending on your Python installation, you may have to use `pip3` instead of `pip`.\n\n\nInstallation from local copy\n----------------------------\n\n``git clone https://github.com/webrecorder/pywb``\n\nTo install from a locally cloned copy, install with ``pip install -e .`` or ``python setup.py install``.\n\nTo run tests, we recommend installing ``pip install tox tox-current-env`` and then running ``tox --current-env`` to test in your current Python environment.\n\nTo Build docs locally, run:  ``cd docs; make html``. (The docs will be built in ``./_build/html/index.html``)\n\n\nRunning\n-------\n\nAfter installation, you can run ``pywb`` or ``wayback``.\n\nConsult the local or `online docs \u003chttps://pywb.readthedocs.org\u003e`_ for latest usage and configuration details.\n\n\nDocumentation\n-------------\n\nThe pywb documentation is extensive. Some links to a few key guides:\n\n* `Getting Started Guide \u003chttps://pywb.readthedocs.io/en/latest/manual/usage.html#getting-started\u003e`_\n\n* `Embargo and Access Control Guide \u003chttps://pywb.readthedocs.io/en/latest/manual/access-control.html\u003e`_\n\n* `Localization and Multi-Language Guide \u003chttps://pywb.readthedocs.io/en/latest/manual/localization.html\u003e`_\n\n* `Deployment Guide \u003chttps://pywb.readthedocs.io/en/latest/manual/usage.html#deployment\u003e`_\n\n* `OpenWayback Transition Guide \u003chttps://pywb.readthedocs.io/en/latest/manual/owb-transition.html\u003e`_\n\n\nContributions \u0026 Bug Reports\n---------------------------\n\nUsers are encouraged to fork and contribute to this project to keep improving web archiving tools. Please consult the `contributing guide \u003cCONTRIBUTING.md\u003e`_ for information on how to contribute to pywb.\n","funding_links":["https://github.com/sponsors/webrecorder"],"categories":["Tools \u0026 Software","Python","\u003ca id=\"9eee96404f868f372a6cbc6769ccb7f8\"\u003e\u003c/a\u003e新添加的","JavaScript","\u003ca id=\"58b6684347a223e01d4d76d9ca185a88\"\u003e\u003c/a\u003eReplay\u0026\u0026重播","python","\u003ca id=\"9eee96404f868f372a6cbc6769ccb7f8\"\u003e\u003c/a\u003e工具","Software","Web Archiving"],"sub_categories":["Replay","\u003ca id=\"31185b925d5152c7469b963809ceb22d\"\u003e\u003c/a\u003e新添加的","Web Archive Replay","Replay \u0026 Access"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwebrecorder%2Fpywb","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwebrecorder%2Fpywb","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwebrecorder%2Fpywb/lists"}