Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/venumadhav2407/redbus_streamlit_app
Redbus Data Scraping with Selenium & Dynamic Filtering using Streamlit
https://github.com/venumadhav2407/redbus_streamlit_app
python3 selenium-python streamlit
Last synced: about 1 month ago
JSON representation
Redbus Data Scraping with Selenium & Dynamic Filtering using Streamlit
- Host: GitHub
- URL: https://github.com/venumadhav2407/redbus_streamlit_app
- Owner: venumadhav2407
- Created: 2024-10-03T06:59:36.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2024-10-16T17:51:17.000Z (3 months ago)
- Last Synced: 2024-10-19T16:10:10.276Z (3 months ago)
- Topics: python3, selenium-python, streamlit
- Language: Jupyter Notebook
- Homepage:
- Size: 1.11 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Redbus Streamlit application
## Demo App
[![Streamlit App](https://static.streamlit.io/badges/streamlit_badge_black_white.svg)](https://redbus-app.streamlit.app/)
![image](https://github.com/user-attachments/assets/5ed1f227-0860-4a25-8ddd-02465ff8b4b5)
![image](https://github.com/user-attachments/assets/d3c54f06-1a08-45d4-b212-db2b97951060)
![image](https://github.com/user-attachments/assets/3c00f4cb-6715-4526-8556-8f2d48ca2311)
![image](https://github.com/user-attachments/assets/8a12f176-a214-4fea-83bb-d39b0cec2d14)Description of the app ...
## Project Title : `Redbus Data Scraping with Selenium & Dynamic Filtering using Streamlit`
## Domain : Transportation
## You should aim to:
Successfully scrape a minimum of 10 Government State Bus Transport data from Redbus website using Selenium. Also include the private bus information for the selected routes.
Store the data in a structured SQL database.
Develop an interactive Streamlit application for data filtering.
Ensure the application is user-friendly and efficient.## Overview
> **This project demonstrates how to use `Selenium`, a web automation tool, to scrape bus ticket data from Redbus.com. It leverages `Streamlit`, a Python framework for building interactive web applications, to provide a dynamic user interface for filtering the scraped data.**
>
> **I combined scraped data from multiple Redbus state buses into a unified CSV file and standardized its format.**
>
> **I use `SQLite3` as a database to store data of redbus.**
>
> **Using `Streamlit` web framework for building dynamic filtering application for easy to use.**> * Application contains search parameters include :
- Source
- Destination
- Filter Option by:
- Rating
- Price
- Bus Type
## Challenges:
> 1. **Dynamic Content and JavaScript Rendering**
>
> 2. **Data Consistency and Formatting**
>
> 3. **Data Quality and Accuracy**
**Reference**:
- https://github.com/Tharanipriyadevi/Red_bus© 2024