https://github.com/srivathsanp23/redbus-data-scraping-with-selenium

RedBus Data Scraping with selenium and Dynamic Filtering using Streamlit
https://github.com/srivathsanp23/redbus-data-scraping-with-selenium

data-scrape mysql pandas-dataframe python selenium-python selenium-webdriver streamlit

Last synced: about 1 month ago
JSON representation

RedBus Data Scraping with selenium and Dynamic Filtering using Streamlit

• Host: GitHub
• URL: https://github.com/srivathsanp23/redbus-data-scraping-with-selenium
• Owner: SrivathsanP23
• Created: 2024-08-19T09:56:56.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-09-04T17:00:47.000Z (5 months ago)
• Last Synced: 2024-11-03T08:42:06.227Z (3 months ago)
• Topics: data-scrape, mysql, pandas-dataframe, python, selenium-python, selenium-webdriver, streamlit
• Language: Jupyter Notebook
• Homepage: https://redbus-datascraping-with-selenium.streamlit.app/
• Size: 1.44 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
Install Dependencies:





Use the following command to install the packages specified in requirements.txt:


pip install -r requirements.txt




Run The Code:




Streamlit run project.py


Hint: 

use XPATH for scraping as it offers many features and is flexible
 


yourdriver.find_elements(By.XPATH,"//div[@class='']")




Actionchains- help to simulate keyboard inputs , scrolling and other automation processes for execution


![image](https://github.com/user-attachments/assets/71c79471-37b8-409b-82cc-14997f91ac3a)

![image](https://github.com/user-attachments/assets/55e20158-9480-48b9-9b44-ff615b825303)

![image](https://github.com/user-attachments/assets/32939f16-17bf-4d11-baa9-5ef649bf71ef)

![image](https://github.com/user-attachments/assets/48c73691-96b1-48b6-ae78-587adfd3e612)

![image](https://github.com/user-attachments/assets/559e444b-34a3-4334-9001-efaf5c564665)

![image](https://github.com/user-attachments/assets/2ff06127-e850-4310-b7c3-1ca5600b9f02)