{"id":22908367,"url":"https://github.com/philippdrebes/mscids_cip02","last_synced_at":"2026-05-05T23:33:10.242Z","repository":{"id":167342350,"uuid":"627892155","full_name":"philippdrebes/MSCIDS_CIP02","owner":"philippdrebes","description":"This project aims to extract hiking routes data from the websites SAC, Schweizmobil, and Komoot.","archived":false,"fork":false,"pushed_at":"2023-05-19T18:40:37.000Z","size":7484,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-11-21T03:03:14.499Z","etag":null,"topics":["beautifulsoup4","hiking","mariadb","python","selenium","switzerland","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/philippdrebes.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-04-14T12:34:38.000Z","updated_at":"2023-05-19T18:11:07.000Z","dependencies_parsed_at":null,"dependency_job_id":"b65b4516-59e8-4898-ac50-8696291ae7f6","html_url":"https://github.com/philippdrebes/MSCIDS_CIP02","commit_stats":null,"previous_names":["philippdrebes/mscids_cip02"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/philippdrebes/MSCIDS_CIP02","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philippdrebes%2FMSCIDS_CIP02","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philippdrebes%2FMSCIDS_CIP02/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philippdrebes%2FMSCIDS_CIP02/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philippdrebes%2FMSCIDS_CIP02/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/philippdrebes","download_url":"https://codeload.github.com/philippdrebes/MSCIDS_CIP02/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/philippdrebes%2FMSCIDS_CIP02/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32672675,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-05T11:29:49.557Z","status":"ssl_error","status_checked_at":"2026-05-05T11:29:48.587Z","response_time":54,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","hiking","mariadb","python","selenium","switzerland","webscraping"],"created_at":"2024-12-14T03:21:27.151Z","updated_at":"2026-05-05T23:33:10.227Z","avatar_url":"https://github.com/philippdrebes.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Hiking Routes in Switzerland\n\nThis project aims to extract hiking routes data from the websites SAC, Schweizmobil, and Komoot. The data includes route descriptions, difficulty, distance, elevation change, and other relevant information.\n\n## Prerequisites\n\nTo run the project, you need to have Python 3 installed on your machine, as well as the following packages:\n- selenium\n- beautifulsoup4\n- pandas\n- mariadb\n- plus a few others... (see `requirements.txt`)\n\nWe recommend using virtualenv to manage dependencies.\n\n## Installation\n\n1. Clone the repository to your local machine.\n2. Create a virtual environment using virtualenv.\n3. Activate the virtual environment.\n4. Install the dependencies using `pip install -r requirements.txt`.\n5. Run the code.\n\n## Repository Structure\n\nThe repository is organized as follows:\n\n- `docs`: documentation files\n- `src`: source code files\n  - `database`: database-related code\n  - `extractors`: website-specific extraction code\n    - `KomootExtractor.py`: extractor for Komoot website\n    - `sac`: extractor for SAC website\n    - `schweizmobil`: extractor for Schweizmobil website\n    - `SeleniumUtil.py`: utility functions for Selenium web driver\n  - `loaders`: code to load data into database\n  - `models`: data models\n  - `output`: output files\n  - `transformers`: code to transform data\n  - `main.py`: main script to run the data extraction process\n- `Makefile`: makefile with common tasks\n- `requirements.txt`: list of required packages\n- `README.md`: this file\n\n## Contributing\n\nIf you find any issues or have suggestions for improvement, please feel free to submit a pull request or open an issue.\n\n## License\n\nThis project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphilippdrebes%2Fmscids_cip02","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fphilippdrebes%2Fmscids_cip02","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fphilippdrebes%2Fmscids_cip02/lists"}