{"id":29315195,"url":"https://github.com/avijit-jana/redbus-data-scraper-dashboard","last_synced_at":"2026-05-09T06:33:30.471Z","repository":{"id":281521054,"uuid":"848347387","full_name":"Avijit-Jana/RedBus-Data-Scraper-Dashboard","owner":"Avijit-Jana","description":"A Streamlit-based application leveraging Selenium to automate data scraping from Redbus, enabling efficient collection, analysis, and visualization of bus travel data for improved operational efficiency and strategic planning in the transportation industry.","archived":false,"fork":false,"pushed_at":"2025-09-04T11:28:36.000Z","size":499,"stargazers_count":1,"open_issues_count":4,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-09-04T13:26:13.470Z","etag":null,"topics":["automation","dashboard","data-analysis","data-visualisation","data-visualization","datadrivendecisions","filtering","python3","redbus","selenium","selenium-python","streamlit","streamlit-application","travel","web-scraping","webscrapping"],"latest_commit_sha":null,"homepage":"https://github.com/Avijit-Jana/RedBus-Data-Scraper-Dashboard","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Avijit-Jana.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-08-27T15:41:43.000Z","updated_at":"2025-09-04T11:28:29.000Z","dependencies_parsed_at":null,"dependency_job_id":"3c8c635c-553b-40ae-9d27-0b92a3c677f9","html_url":"https://github.com/Avijit-Jana/RedBus-Data-Scraper-Dashboard","commit_stats":null,"previous_names":["avijit-jana/redbus-data_scraping_and_filtering_with_streamlit_app","avijit-jana/redbus-data-scraper-dashboard"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Avijit-Jana/RedBus-Data-Scraper-Dashboard","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Avijit-Jana%2FRedBus-Data-Scraper-Dashboard","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Avijit-Jana%2FRedBus-Data-Scraper-Dashboard/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Avijit-Jana%2FRedBus-Data-Scraper-Dashboard/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Avijit-Jana%2FRedBus-Data-Scraper-Dashboard/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Avijit-Jana","download_url":"https://codeload.github.com/Avijit-Jana/RedBus-Data-Scraper-Dashboard/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Avijit-Jana%2FRedBus-Data-Scraper-Dashboard/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32809669,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-08T08:22:46.396Z","status":"online","status_checked_at":"2026-05-09T02:00:06.633Z","response_time":123,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["automation","dashboard","data-analysis","data-visualisation","data-visualization","datadrivendecisions","filtering","python3","redbus","selenium","selenium-python","streamlit","streamlit-application","travel","web-scraping","webscrapping"],"created_at":"2025-07-07T11:20:14.310Z","updated_at":"2026-05-09T06:33:30.453Z","avatar_url":"https://github.com/Avijit-Jana.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n# 🚌Redbus Project🚌\n\n![GitHub repo size](https://img.shields.io/github/repo-size/Avijit-Jana/RedBus-Data-Scraper-Dashboard?style=plastic)\n![GitHub language count](https://img.shields.io/github/languages/count/Avijit-Jana/RedBus-Data-Scraper-Dashboard?style=plastic)\n![GitHub top language](https://img.shields.io/github/languages/top/Avijit-Jana/cnn-architectures-benchmark?style=plastic)\n![GitHub last commit](https://img.shields.io/github/last-commit/Avijit-Jana/RedBus-Data-Scraper-Dashboard?color=red\u0026style=plastic)\n\n\u003c/div\u003e\n\n## Table of Contents\n\n- [📖**Project Description**](#project-description)\n- [🧑‍💼**Business Use Cases**](#business-use-cases)\n- [📁**Data Set Explanation**](#data-set-explanation)\n- [📊**Project Evaluation Metrics**](#project-evaluation-metrics)\n- [🚩**How to Approach this Project**](#Approach)\n\n## 📖Project Description\nThe \"Redbus Data Scraping and Filtering with Streamlit Application\" aims to revolutionize the transportation industry by providing a comprehensive solution for collecting, analyzing, and visualizing bus travel data. By utilizing Selenium for web scraping, this project automates the extraction of detailed information from Redbus, including bus routes, schedules, prices, and seat availability. By streamlining data collection and providing powerful tools for data-driven decision-making, this project can significantly improve operational efficiency and strategic planning in the transportation industry. \n\n## 🧑‍💼Business Use Cases\nThe solution can be applied to various business scenarios including: \n- **Travel Aggregators:** Providing real-time bus schedules and seat availability for \ncustomers. \n- **Market Analysis:** Analyzing travel patterns and preferences for market \nresearch. \n- **Customer Service:** Enhancing user experience by offering customized travel \noptions based on data insights. \n- **Competitor Analysis:** Comparing pricing and service levels with competitors. \n\n## 📁Data Set Explanation\n- **Source:** Data will be scraped from the Redbus website. **Link-** https://www.redbus.in/ \n- **Format:** The scraped data will be stored in a SQL database. \n- **Required Fields:** Bus routes Link,Bus route Name, Bus name, Bus Type(Sleeper/Seater),  Departing Time, Duration, Reaching_Time, Star-rating, Price, Seat_availability\n\n## 📊Project Evaluation Metrics\n- **Data Scraping Accuracy:** Completeness and correctness of the scraped data.\n- **Application Usability:** User experience and ease of use of the Streamlit application.\n- **Filter Functionality:** Effectiveness and responsiveness of data filters.\n- **Code Quality:** Adherence to coding standards and best practices.\n\n## 🚩Approach:\n1. **Data Scraping:**\n    - Use Selenium to automate the extraction of Redbus data including routes, schedules, prices, and seat availability.\n2. **Data Storage:**\n    - Store the scraped data in a SQL database.\n3. **Streamlit Application:**\n    - Develop a Streamlit application to display and filter the scraped data.\n    - Implement various filters such as bustype, route, price range, star rating, availability.\n4. **Data Analysis/Filtering using Streamlit:**\n    - Use SQL queries to retrieve and filter data based on user inputs.\n    - Use Streamlit to allow users to interact with and filter the data through the application.\n    - Use Streamlit to display the filtered data in a user-friendly format.\n\n\n```bash\npip install selenium pandas streamlit\n```\n\n\u003cdiv align=\"middle\"\u003e\n\n![Badge](https://img.shields.io/badge/Developed%20By-Avijit_Jana-blueviolet?style=for-the-badge)\n\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Favijit-jana%2Fredbus-data-scraper-dashboard","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Favijit-jana%2Fredbus-data-scraper-dashboard","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Favijit-jana%2Fredbus-data-scraper-dashboard/lists"}