Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/venumadhav2407/redbus_streamlit_app

Redbus Data Scraping with Selenium & Dynamic Filtering using Streamlit
https://github.com/venumadhav2407/redbus_streamlit_app

python3 selenium-python streamlit

Last synced: about 1 month ago
JSON representation

Redbus Data Scraping with Selenium & Dynamic Filtering using Streamlit

Awesome Lists containing this project

README

        

# Redbus Streamlit application

## Demo App

[![Streamlit App](https://static.streamlit.io/badges/streamlit_badge_black_white.svg)](https://redbus-app.streamlit.app/)

![image](https://github.com/user-attachments/assets/5ed1f227-0860-4a25-8ddd-02465ff8b4b5)
![image](https://github.com/user-attachments/assets/d3c54f06-1a08-45d4-b212-db2b97951060)
![image](https://github.com/user-attachments/assets/3c00f4cb-6715-4526-8556-8f2d48ca2311)
![image](https://github.com/user-attachments/assets/8a12f176-a214-4fea-83bb-d39b0cec2d14)

Description of the app ...
## Project Title : `Redbus Data Scraping with Selenium & Dynamic Filtering using Streamlit`
## Domain : Transportation
## You should aim to:
Successfully scrape a minimum of 10 Government State Bus Transport data from Redbus website using Selenium. Also include the private bus information for the selected routes.
Store the data in a structured SQL database.
Develop an interactive Streamlit application for data filtering.
Ensure the application is user-friendly and efficient.

## Overview
> **This project demonstrates how to use `Selenium`, a web automation tool, to scrape bus ticket data from Redbus.com. It leverages `Streamlit`, a Python framework for building interactive web applications, to provide a dynamic user interface for filtering the scraped data.**
>
> **I combined scraped data from multiple Redbus state buses into a unified CSV file and standardized its format.**
>
> **I use `SQLite3` as a database to store data of redbus.**
>
> **Using `Streamlit` web framework for building dynamic filtering application for easy to use.**

> * Application contains search parameters include :
- Source
- Destination
- Filter Option by:
- Rating
- Price
- Bus Type

## Challenges:
> 1. **Dynamic Content and JavaScript Rendering**
>
> 2. **Data Consistency and Formatting**
>
> 3. **Data Quality and Accuracy**

**Reference**:
- https://github.com/Tharanipriyadevi/Red_bus

© 2024