{"id":15199112,"url":"https://github.com/sathiyan2114/redbus-data-scraping-project","last_synced_at":"2026-02-12T21:31:15.904Z","repository":{"id":252120047,"uuid":"838959779","full_name":"Sathiyan2114/Redbus-Data-scraping-Project","owner":"Sathiyan2114","description":"The Redbus Data Scraping and Analysis project aims to create an interactive application for data filtering, analysis, and automation of bus transit data extraction from the Redbus website.","archived":false,"fork":false,"pushed_at":"2024-08-07T17:58:10.000Z","size":559,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-10-11T18:22:27.690Z","etag":null,"topics":["data-filtering","data-science","data-scraping","python","selenium","sql","streamlit"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Sathiyan2114.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-08-06T17:19:53.000Z","updated_at":"2024-08-07T17:58:14.000Z","dependencies_parsed_at":null,"dependency_job_id":"523d2082-3888-4f11-b911-4f5f4e3d28fb","html_url":"https://github.com/Sathiyan2114/Redbus-Data-scraping-Project","commit_stats":{"total_commits":4,"total_committers":2,"mean_commits":2.0,"dds":0.25,"last_synced_commit":"24f086cb377bfa61640209e1319cc17e61d28fbb"},"previous_names":["sathiyan2114/redbus-data-scraping-project"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sathiyan2114%2FRedbus-Data-scraping-Project","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sathiyan2114%2FRedbus-Data-scraping-Project/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sathiyan2114%2FRedbus-Data-scraping-Project/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Sathiyan2114%2FRedbus-Data-scraping-Project/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Sathiyan2114","download_url":"https://codeload.github.com/Sathiyan2114/Redbus-Data-scraping-Project/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":219859642,"owners_count":16556035,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-filtering","data-science","data-scraping","python","selenium","sql","streamlit"],"created_at":"2024-09-28T02:00:40.888Z","updated_at":"2025-10-03T15:10:35.280Z","avatar_url":"https://github.com/Sathiyan2114.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Data Scraping from Redbus\n\nThe objective of this project is to automatically extract and analyze Redbus website bus route data. The goal is to compile extensive information regarding bus services, both public and private, such as route maps, bus kinds, costs, star ratings, and seat availability. This project uses web scraping techniques to create an interactive application that allows users to explore and filter bus service data with ease. The end result is a valuable set of insights.\n\nKey Features\n\nUsing Selenium for Web Scraping: This method automates the process of obtaining bus schedules and routes straight from the Redbus website.\n\nMySQL Data Storage: Quick and adaptable data retrieval is made possible by effectively storing the scraped data in a structured MySQL database.\n\nThe interactive streamlit application provides an easy-to-use interface for sorting through and evaluating bus service data. Results may be filtered by the user according to bus type, route, price range, star rating, and availability of seats.\n\nData analysis and visualization: By offering consumers lucid insights via data visualizations, this tool assists them in making well-informed judgments regarding their bus travel alternatives.\n\nTechnologies Used\n\nSelenium: For browser automation and web scraping.\n\nMySQL: For reliable and expandable data hosting.\n\nSQLAlchemy: For running SQL queries and maintaining database connections.\n\nStreamlit: To construct an interactive online application that lets users see and filter the information.\n\nPython is the main programming language used for creating applications, manipulating data, and writing scripts.\n\nProject Goals\n\nAutomate Data Extraction: Create a dependable and effective technique for obtaining information about bus services from the Redbus website.\n\nStore Data Systematically: To make administration and access easier, arrange the data that has been scraped into a MySQL database.\n\nBuild a Streamlit application with an intuitive user interface that enables users to work with the data, apply filters, and derive insights from visualizations.\n\nOffer Useful Insights: Give consumers the ability to examine bus service statistics according to different standards, assisting them in making more informed travel choices.\n\nIn order to provide a comprehensive tool for investigating bus services, this project integrates the capabilities of web scraping, data storage, and interactive data presentation. Its accessible and useful design makes it simpler for users to locate the information they want quickly.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsathiyan2114%2Fredbus-data-scraping-project","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsathiyan2114%2Fredbus-data-scraping-project","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsathiyan2114%2Fredbus-data-scraping-project/lists"}