An open API service indexing awesome lists of open source software.

https://github.com/amazenmb/web-scraping

Web Scraping Methods using Python
https://github.com/amazenmb/web-scraping

analytics beautifulsoup data lxml pyautogui-automation python scheduling schedulingscraping selenium webdriver webscraping xpath

Last synced: about 2 months ago
JSON representation

Web Scraping Methods using Python

Awesome Lists containing this project

README

          

# Web-Scraping
Web Scraping is often done to extract useful data from websites automatically through scripts (usually python) rather than manual copy paste. You know this data can be used for multiple applications like:
- Gathering Research data
- Collecting news and srticles
- Track prices on ecom websites
- Extract Job listings
- Generate leads

Some popular Python libraries that are used for this are:
Requests (To fetch web pages)
BeautifulSoup (Parse HTML - for static websites)
Selenium (for dynamic content)

Here, I have used each of these methods for handling web scraping. Follow the Jupyter notebook that is self-explainatory and easy to understand.