https://github.com/AhmadIbrahiim/Website-downloader

💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
https://github.com/AhmadIbrahiim/Website-downloader

assets downloader offline-web-pages scraper

Last synced: about 2 months ago
JSON representation

💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js

• Host: GitHub
• URL: https://github.com/AhmadIbrahiim/Website-downloader
• Owner: AhmadIbrahiim
• License: mit
• Created: 2019-10-26T08:06:23.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2024-07-12T18:27:47.000Z (2 months ago)
• Last Synced: 2024-07-12T20:50:42.207Z (2 months ago)
• Topics: assets, downloader, offline-web-pages, scraper
• Language: HTML
• Homepage: https://website-downloader.onrender.com
• Size: 4.03 MB
• Stars: 1,484
• Watchers: 22
• Forks: 503
• Open Issues: 10
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.md

Awesome Lists containing this project

README

        
## Complete Website Downloader 💾

Download the complete source code of any website (including all assets) 🔨.

👉 Live Demo: https://website-downloader.onrender.com

![enter image description here](https://github.com/AhmadIbrahiim/Website-downloader/blob/master/public/Record.gif?raw=true)



  ![CodeFactor](https://www.codefactor.io/repository/github/ahmadibrahiim/website-downloader/badge)



## Description 📒

 Website downloader works with `wget` and `archiver` to download all websites assets and compress then sends it back to the user through socket channel

 

 **wget params the being used**

 

 `wget --mirror --convert-links --adjust-extension --page-requisites 

--no-parent http://example.org`

 **Explanation of the various flags:**

 - --mirror – Makes (among other things) the download recursive.

- --convert-links – convert all the links (also to stuff like CSS stylesheets) to relative, so it will be suitable for offline viewing.

- --adjust-extension – Adds suitable extensions to filenames (html or css) depending on their content-type.

- --page-requisites – Download things like CSS style-sheets and images required to properly display the page offline.

- --no-parent – When recursing do not ascend to the parent directory. It useful for restricting the download to only a portion of the site

### Deploy on cloud providers

[![Run on Replit](https://binbashbanana.github.io/deploy-buttons/buttons/remade/replit.svg)](https://replit.com/github/AhmadIbrahiim/Website-downloader)

[![Remix on Glitch](https://binbashbanana.github.io/deploy-buttons/buttons/remade/glitch.svg)](https://glitch.com/edit/#!/import/github/AhmadIbrahiim/Website-downloader)

[![Deploy on Railway](https://binbashbanana.github.io/deploy-buttons/buttons/remade/railway.svg)](https://railway.app/new/template?template=https://github.com/AhmadIbrahiim/Website-downloader)

[![Deploy to Cyclic](https://binbashbanana.github.io/deploy-buttons/buttons/remade/cyclic.svg)](https://app.cyclic.sh/api/app/deploy/AhmadIbrahiim/Website-downloader)

[![Deploy to Koyeb](https://binbashbanana.github.io/deploy-buttons/buttons/remade/koyeb.svg)](https://app.koyeb.com/deploy?type=git&repository=github.com/AhmadIbrahiim/Website-downloader&branch=main&name=Website-downloader)

[![Deploy to Render](https://binbashbanana.github.io/deploy-buttons/buttons/remade/render.svg)](https://render.com/deploy?repo=https://github.com/AhmadIbrahiim/Website-downloader)

## How to run it 🤔

- `git clone https://github.com/AhmadIbrahiim/Website-downloader.git`

- `cd Website-downloader`

- `$ npm install`

- `$ npm start`

- `http://localhost:3000/`

# How To Contribute:

 - Open Issue(s) with any bugs you notice.

 - Please create Pull Requests if you think it would be an added value towards our program.

## Liked it ? You can buy a coffee:



Thank you,

Email: [email protected]

https://www.ahmed-ibrahim.com