An open API service indexing awesome lists of open source software.

https://github.com/iyashwantsaini/web-scraping-python

Web Scraping | requests | Beautiful Soup | pyQt5
https://github.com/iyashwantsaini/web-scraping-python

Last synced: 3 months ago
JSON representation

Web Scraping | requests | Beautiful Soup | pyQt5

Awesome Lists containing this project

README

        

# WEB SCRAPING PYTHON

# STEPS (dynamic/static content)
1) Importing libraries
2) passing URL to scrapping function
3) getting response in form of HTML
4) finding classes of required data
5) getting data using CSS selectors
6) writing data to CSV file

# STEPS (dynamic content - js rendered)
1) Importing libraries , pyQt5
2) passing URL to scrapping function
3) creating client class to act as a browser
4) loading the webpage using pyQt5's Qwebpage
5) converting the loaded data into HTML
6) finding classes of required data
7) getting data using CSS selectors
8) writing data to CSV file