{"id":13395199,"url":"https://github.com/Y2Z/monolith","last_synced_at":"2025-03-13T20:31:58.201Z","repository":{"id":37359495,"uuid":"82530909","full_name":"Y2Z/monolith","owner":"Y2Z","description":"⬛️ CLI tool for saving complete web pages as a single HTML file","archived":false,"fork":false,"pushed_at":"2024-09-25T23:15:45.000Z","size":4130,"stargazers_count":10978,"open_issues_count":61,"forks_count":316,"subscribers_count":61,"default_branch":"master","last_synced_at":"2024-10-05T23:34:29.716Z","etag":null,"topics":["come-and-take-it","e-hoarding","its-mine","make-the-internet-great-again","no-more-404","procrastination","save-the-internet","tab-rehab"],"latest_commit_sha":null,"homepage":"https://crates.io/crates/monolith","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc0-1.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Y2Z.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":"snshn"}},"created_at":"2017-02-20T07:47:35.000Z","updated_at":"2024-10-05T20:32:33.000Z","dependencies_parsed_at":"2024-01-09T18:04:49.296Z","dependency_job_id":"ab6a32db-19f0-49a6-9905-68c4fc7cc714","html_url":"https://github.com/Y2Z/monolith","commit_stats":{"total_commits":380,"total_committers":28,"mean_commits":"13.571428571428571","dds":"0.42105263157894735","last_synced_commit":"a3feb7b721162bf5f9ac5224ac7fa578566facb9"},"previous_names":[],"tags_count":24,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Y2Z%2Fmonolith","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Y2Z%2Fmonolith/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Y2Z%2Fmonolith/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Y2Z%2Fmonolith/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Y2Z","download_url":"https://codeload.github.com/Y2Z/monolith/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243244051,"owners_count":20260086,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["come-and-take-it","e-hoarding","its-mine","make-the-internet-great-again","no-more-404","procrastination","save-the-internet","tab-rehab"],"created_at":"2024-07-30T17:01:45.950Z","updated_at":"2025-03-13T20:31:58.194Z","avatar_url":"https://github.com/Y2Z.png","language":"Rust","funding_links":["https://github.com/sponsors/snshn"],"categories":["Rust","Tools \u0026 Software","CLI tools","others","\u003ca name=\"online\"\u003e\u003c/a\u003eOnline search and resources","Web","Command Line Tools","Table of Contents","开发工具\u0026框架"],"sub_categories":["Acquisition","Other","Archiving"],"readme":"[![monolith build status on GNU/Linux](https://github.com/Y2Z/monolith/workflows/GNU%2FLinux/badge.svg)](https://github.com/Y2Z/monolith/actions?query=workflow%3AGNU%2FLinux)\n[![monolith build status on macOS](https://github.com/Y2Z/monolith/workflows/macOS/badge.svg)](https://github.com/Y2Z/monolith/actions?query=workflow%3AmacOS)\n[![monolith build status on Windows](https://github.com/Y2Z/monolith/workflows/Windows/badge.svg)](https://github.com/Y2Z/monolith/actions?query=workflow%3AWindows)\n\n```\n _____     ______________    __________      ___________________    ___\n|     \\   /              \\  |          |    |                   |  |   |\n|      \\_/       __       \\_|    __    |    |    ___     ___    |__|   |\n|               |  |            |  |   |    |   |   |   |   |          |\n|   |\\     /|   |__|    _       |__|   |____|   |   |   |   |    __    |\n|   | \\___/ |          | \\                      |   |   |   |   |  |   |\n|___|       |__________|  \\_____________________|   |___|   |___|  |___|\n```\n\nA data hoarder’s dream come true: bundle any web page into a single HTML file. You can finally replace that gazillion of open tabs with a gazillion of .html files stored somewhere on your precious little drive.\n\nUnlike the conventional “Save page as”, `monolith` not only saves the target document, it embeds CSS, image, and JavaScript assets **all at once**, producing a single HTML5 document that is a joy to store and share.\n\nIf compared to saving websites with `wget -mpk`, this tool embeds all assets as data URLs and therefore lets browsers render the saved page exactly the way it was on the Internet, even when no network connection is available.\n\n\n---------------------------------------------------\n\n\n## Installation\n\n#### Using [Cargo](https://crates.io/crates/monolith) (cross-platform)\n\n```console\ncargo install monolith\n```\n\n#### Via [Homebrew](https://formulae.brew.sh/formula/monolith) (macOS and GNU/Linux)\n\n```console\nbrew install monolith\n```\n\n#### Via [Chocolatey](https://community.chocolatey.org/packages/monolith) (Windows)\n\n```console\nchoco install monolith\n```\n\n#### Via [Scoop](https://scoop.sh/#/apps?q=monolith) (Windows)\n\n```console\nscoop install main/monolith\n```\n\n#### Via [Winget](https://winstall.app/apps/Y2Z.Monolith) (Windows)\n\n```console\nwinget install --id=Y2Z.Monolith -e\n```\n\n#### Via [MacPorts](https://ports.macports.org/port/monolith/summary) (macOS)\n\n```console\nsudo port install monolith\n```\n\n#### Using [Snapcraft](https://snapcraft.io/monolith) (GNU/Linux)\n\n```console\nsnap install monolith\n```\n\n#### Using [Guix](https://packages.guix.gnu.org/packages/monolith) (GNU/Linux)\n\n```console\nguix install monolith\n```\n\n#### Using [NixPkgs](https://search.nixos.org/packages?channel=unstable\u0026show=monolith\u0026query=monolith)\n\n```console\nnix-env -iA nixpkgs.monolith\n```\n\n#### Using [Flox](https://flox.dev)\n\n```console\nflox install monolith\n```\n\n#### Using [Pacman](https://archlinux.org/packages/extra/x86_64/monolith) (Arch Linux)\n\n```console\npacman -S monolith\n```\n\n#### Using [aports](https://pkgs.alpinelinux.org/packages?name=monolith) (Alpine Linux)\n\n```console\napk add monolith\n```\n\n#### Using [XBPS Package Manager](https://voidlinux.org/packages/?q=monolith) (Void Linux)\n\n```console\nxbps-install -S monolith\n```\n\n#### Using [FreeBSD packages](https://svnweb.freebsd.org/ports/head/www/monolith/) (FreeBSD)\n\n```console\npkg install monolith\n```\n\n#### Using [FreeBSD ports](https://www.freshports.org/www/monolith/) (FreeBSD)\n\n```console\ncd /usr/ports/www/monolith/\nmake install clean\n```\n\n#### Using [pkgsrc](https://pkgsrc.se/www/monolith) (NetBSD, OpenBSD, Haiku, etc)\n\n```console\ncd /usr/pkgsrc/www/monolith\nmake install clean\n```\n\n#### Using [containers](https://www.docker.com/)\n\n```console\ndocker build -t y2z/monolith .\nsudo install -b dist/run-in-container.sh /usr/local/bin/monolith\n```\n\n#### From [source](https://github.com/Y2Z/monolith)\n\nDependencies: `libssl`, `cargo`\n\n\u003cdetails\u003e\n  \u003csummary\u003eInstall cargo (GNU/Linux)\u003c/summary\u003e\n Check if cargo is installed\n \n ```console\n cargo -v\n ```\n\n If cargo is not already installed, install and add it to your existing ```$PATH``` (paraphrasing the [official installation instructions](https://doc.rust-lang.org/cargo/getting-started/installation.html)):\n \n ```console\n curl https://sh.rustup.rs -sSf | sh\n . \"$HOME/.cargo/env\"\n ```\n\nProceed with installing from source:\n\u003c/details\u003e\n\n```console\ngit clone https://github.com/Y2Z/monolith.git\ncd monolith\nmake install\n```\n\n#### Using [pre-built binaries](https://github.com/Y2Z/monolith/releases) (Windows, ARM-based devices, etc)\n\nEvery release contains pre-built binaries for Windows, GNU/Linux, as well as platforms with non-standard CPU architecture.\n\n\n---------------------------------------------------\n\n\n## Usage\n\n```console\nmonolith https://lyrics.github.io/db/P/Portishead/Dummy/Roads/ -o portishead-roads-lyrics.html\n```\n\n```console\ncat some-site-page.html | monolith -aIiFfcMv -b https://some.site/ - \u003e some-site-page-with-assets.html\n```\n\n\n---------------------------------------------------\n\n\n## Options\n\n - `-a`: Exclude audio sources\n - `-b`: Use `custom base URL`\n - `-B`: Forbid retrieving assets from specified domain(s)\n - `-c`: Exclude CSS\n - `-C`: Read cookies from `file`\n - `-d`: Allow retrieving assets only from specified `domain(s)`\n - `-e`: Ignore network errors\n - `-E`: Save document using `custom encoding`\n - `-f`: Omit frames\n - `-F`: Exclude web fonts\n - `-h`: Print help information\n - `-i`: Remove images\n - `-I`: Isolate the document\n - `-j`: Exclude JavaScript\n - `-k`: Accept invalid X.509 (TLS) certificates\n - `-M`: Don't add timestamp and URL information\n - `-n`: Extract contents of NOSCRIPT elements\n - `-o`: Write output to `file` (use “-” for STDOUT)\n - `-q`: Be quiet\n - `-t`: Adjust `network request timeout`\n - `-u`: Provide `custom User-Agent`\n - `-v`: Exclude videos\n - `-V`: Print version number\n\n\n---------------------------------------------------\n\n\n## Whitelisting and blacklisting domains\n\nOptions `-d` and `-B` provide control over what domains can be used to retrieve assets from, e.g.:\n\n```console\nmonolith -I -d example.com -d www.example.com https://example.com -o example-only.html\n```\n\n```console\nmonolith -I -B -d .googleusercontent.com -d googleanalytics.com -d .google.com https://example.com -o example-no-ads.html\n```\n\n---------------------------------------------------\n\n\n## Dynamic content\n\nMonolith doesn't feature a JavaScript engine, hence websites that retrieve and display data after initial load may require usage of additional tools.\n\nFor example, Chromium (Chrome) can be used to act as a pre-processor for such pages:\n\n```console\nchromium --headless --window-size=1920,1080 --run-all-compositor-stages-before-draw --virtual-time-budget=9000 --incognito --dump-dom https://github.com | monolith - -I -b https://github.com -o github.html\n```\n\n\n---------------------------------------------------\n\n\n## Proxies\n\nPlease set `https_proxy`, `http_proxy`, and `no_proxy` environment variables.\n\n\n---------------------------------------------------\n\n\n## Contributing\n\nPlease open an issue if something is wrong, that helps make this project better.\n\n\n---------------------------------------------------\n\n\n## License\n\nTo the extent possible under law, the author(s) have dedicated all copyright related and neighboring rights to this software to the public domain worldwide.\nThis software is distributed without any warranty.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FY2Z%2Fmonolith","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FY2Z%2Fmonolith","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FY2Z%2Fmonolith/lists"}