https://github.com/amssdias/python-web-scrapping
Web Scrapping with Python using Beautifulsoup4 and Selenium.
https://github.com/amssdias/python-web-scrapping
beautifulsoup4 requests selenium-python web-scraping
Last synced: 3 months ago
JSON representation
Web Scrapping with Python using Beautifulsoup4 and Selenium.
- Host: GitHub
- URL: https://github.com/amssdias/python-web-scrapping
- Owner: amssdias
- Created: 2021-01-25T21:23:32.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2021-03-03T11:25:01.000Z (over 4 years ago)
- Last Synced: 2025-01-13T19:24:24.258Z (5 months ago)
- Topics: beautifulsoup4, requests, selenium-python, web-scraping
- Language: Python
- Homepage:
- Size: 57.6 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Python Web Scrapping
This is a practice repository for Web Scraping. We are scrapping few websites in different ways.
## Pre requisites
* [Python](https://www.python.org/downloads/) - 3.8.4 or up
## Pipfile and Pipfile.Lock
Inside the Pipfile there's all the modules name needed for the projects in the folders.
Download Pipenv through the terminal window (make sure you have Python installed), just type `pip install pipenv`.
After installing pipenv all you have to do is to download these two files and in terminal window, got to the folder with these files and run `pipenv install` and automatically will install this modules.
This will create a virtual environment with the modules `beautifulsoup4`, `selenium` and `requests`.
To run this virtual environment all you must do is run `pipenv shell` and to close the virtual environment `exit`.
If any doubts here's a link to some more explanations:
- [Pipenv](https://pipenv-fork.readthedocs.io/en/latest/basics.html)
## Projects
- [Capterra](https://github.com/amssdias/python-web-scrapping/tree/master/Capterra)
- [Quotes](https://github.com/amssdias/python-web-scrapping/tree/master/Scrape%20Quotes)
- [Books](https://github.com/amssdias/python-web-scrapping/tree/master/scraping_books_bs4)