https://github.com/kalebu/website-images-spider
A scraper for downloading all downloadable images on a given website
https://github.com/kalebu/website-images-spider
beautifulsoup4 python python-project python-project-beginner python-tanzania python-webscraping-application requests webscraping
Last synced: 4 days ago
JSON representation
A scraper for downloading all downloadable images on a given website
- Host: GitHub
- URL: https://github.com/kalebu/website-images-spider
- Owner: Kalebu
- Created: 2020-05-22T10:29:18.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2021-01-16T18:49:37.000Z (over 4 years ago)
- Last Synced: 2025-04-19T00:27:38.322Z (5 days ago)
- Topics: beautifulsoup4, python, python-project, python-project-beginner, python-tanzania, python-webscraping-application, requests, webscraping
- Language: Python
- Homepage: https://kalebujordan.dev/
- Size: 3.91 KB
- Stars: 16
- Watchers: 2
- Forks: 8
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Website-Images-Spider
The repo consists of a source of for scraper made in python for downloading/scraping all public available images from a given website.
How it works
----------------
Once you specify the website, the scraper will scans through out a given website to find all public available tlinks and dive into all of those to find if there is any downloadable image , If there is , it will automatically download it and save on your local directory.
Getting started
------------------
To get started using this tool, firstly *clone* or *download* the repository to your computer just as shown below;
```bash
$-> git clone https://github.com/Kalebu/Website-Images-Spider
```
Dependancies
---------------
Before you begin playing this project, I recommend you to install the following dependencies first
```bash
$-> pip install bs4, requests, pillow
```
Move into the Project directory
-------------------------------
Navigate into your project repository either by using **cd** commands or by opening a terminal inside a project repository.
```bash
$-> cd Website-Images-Spider
$ Website-Images-Spider-> python app.py
Enter URL with images :
```
Enjoy downloading the images
-----------------------------
Now once you run the script, it will prompt you to enter a url for a specific website you would like to scrap the images from and then once done, take a coffe while you wait for the images to be downloaded.
Note
--------
This script doesn't work very well with website with a bunch of JS
Issues
-----------
Incase you have any difficulties or issues while trying to run the script
you can raise it on the issues.
Pull Requests
----------------
If you have something to add I welcome pull requests on improvement , you're helpful contribution will be merged as soon as possible
Give it a Star ✴️
--------------------
If you find this repo useful , give it a star
Credits
-----------
All the credits to [kalebu](github.com/kalebu)