https://github.com/splitbrain/sitemapmirror

very simple web site copier written in PHP
https://github.com/splitbrain/sitemapmirror

downloader mirroring scraping

Last synced: about 1 year ago
JSON representation

very simple web site copier written in PHP

• Host: GitHub
• URL: https://github.com/splitbrain/sitemapmirror
• Owner: splitbrain
• Created: 2021-10-14T10:33:53.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2025-02-25T15:12:31.000Z (over 1 year ago)
• Last Synced: 2025-02-25T16:24:42.575Z (over 1 year ago)
• Topics: downloader, mirroring, scraping
• Language: PHP
• Homepage:
• Size: 32.2 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# SiteMapMirror

This is a *very* simple web site copier. It uses a given XML sitemap as a starting point 

to download all the pages and their assets. It does *no* rewriting of URLs so URLs need 

to be relative or server absolute.

Run `composer install` to fetch the requirments, then use the commandline:

    ./smm.php -d download https://example.com/sitemap.xml