{"id":37746249,"url":"https://github.com/felix-engelmann/historic-flight-parser","last_synced_at":"2026-01-16T14:17:03.175Z","repository":{"id":74761552,"uuid":"436050579","full_name":"felix-engelmann/historic-flight-parser","owner":"felix-engelmann","description":"A parser for the Historic Flight Database","archived":false,"fork":false,"pushed_at":"2021-12-07T23:39:40.000Z","size":96,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-04-23T14:24:29.327Z","etag":null,"topics":["departedflights","flights","historical-data","oag","parser"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/felix-engelmann.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2021-12-07T23:02:41.000Z","updated_at":"2024-04-23T14:24:29.327Z","dependencies_parsed_at":null,"dependency_job_id":"0d7e783c-4c8e-484b-92ec-ccbc6a7df3d3","html_url":"https://github.com/felix-engelmann/historic-flight-parser","commit_stats":{"total_commits":3,"total_committers":1,"mean_commits":3.0,"dds":0.0,"last_synced_commit":"a58634eec5186293e50c03a944f6bd7393e6de49"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/felix-engelmann/historic-flight-parser","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/felix-engelmann%2Fhistoric-flight-parser","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/felix-engelmann%2Fhistoric-flight-parser/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/felix-engelmann%2Fhistoric-flight-parser/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/felix-engelmann%2Fhistoric-flight-parser/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/felix-engelmann","download_url":"https://codeload.github.com/felix-engelmann/historic-flight-parser/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/felix-engelmann%2Fhistoric-flight-parser/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28479343,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-16T11:59:17.896Z","status":"ssl_error","status_checked_at":"2026-01-16T11:55:55.838Z","response_time":107,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["departedflights","flights","historical-data","oag","parser"],"created_at":"2026-01-16T14:17:02.553Z","updated_at":"2026-01-16T14:17:03.163Z","avatar_url":"https://github.com/felix-engelmann.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Historic Flight Data Parser\n\nThe conclusive site http://www.departedflights.com/ has plenty of historic flight schedules. Unfortunately they are not in a machine-readable format.\n\nThis repository allows you to parse the data and then access the data for e.g. statistics.\n\n\u003e Disclaimer: This repository does not contain the data itself, but only provides the tools to parse the original data.\n\n## Download the original data\n\nTo parse the data, you first need to download it. This is easily done with a recursive wget command which downloads each html file once with infinite recursion (this is needed for deep pagination):\n\n    wget -nc -r -l inf -A \".html\" http://www.departedflights.com/\n\nThis results in around 23000 files and 210 MB of source files. To easily handle the files, rename the directory to `scrape`.\n\nAdditionally, you need the `https://raw.githubusercontent.com/jpatokal/openflights/master/data/airports.dat` file for time zones and coordinates.\n\n## Scope\nSo far, the script is only tested against the international schedules for 83,89 and 96. The main challenge is to map the departure airport names to IATA codes. This mapping is handled in the `assign.json` file.\n\n## Usage\n\nUncomment one of the dates in `run.py`\n\n    #scheddate = date(1983,7,1)\n    #scheddate = date(1989,1,15)\n    scheddate = date(1996, 10, 1)\n\nand execute `python run.py`\n\n## Statistics\n\nOne direct plot derived from the data is the distance over time for different aircraft types:\n\n![speed diagram](speed-stat.png)\n\nThe parallel line with a time offset of 720 minutes is caused by typos in the am/pm notation of departure and arrival times.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffelix-engelmann%2Fhistoric-flight-parser","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffelix-engelmann%2Fhistoric-flight-parser","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffelix-engelmann%2Fhistoric-flight-parser/lists"}