An open API service indexing awesome lists of open source software.

https://github.com/bimmr/site-crawler

Chromium Extension: Crawl a website
https://github.com/bimmr/site-crawler

chrome-extension crawler downloader sitemap

Last synced: 3 months ago
JSON representation

Chromium Extension: Crawl a website

Awesome Lists containing this project

README

          

# Site-Crawler

Crawl a website for a Sitemap, Links and Images.



  • Crawl a website to get a sitemap of the website

  • Download the web pages

  • Download all the web pages

  • Stylesheets and Script files can be localized so they can be viewed in offline mode

  • View all links on a page

  • Test all links on a page

  • View all images on a page

  • Download all PDFs/Docs on the site/page

  • Download all images on the site/page