https://github.com/projectweekend/transit-stop-collector

Collect GTFS data and maintain a simplified database of transit stops with latitude/longitude.
https://github.com/projectweekend/transit-stop-collector

Last synced: over 1 year ago
JSON representation

Collect GTFS data and maintain a simplified database of transit stops with latitude/longitude.

• Host: GitHub
• URL: https://github.com/projectweekend/transit-stop-collector
• Owner: projectweekend
• License: mit
• Created: 2015-01-11T20:26:06.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2015-08-08T17:38:24.000Z (almost 11 years ago)
• Last Synced: 2025-02-01T19:29:44.194Z (over 1 year ago)
• Language: Python
• Homepage:
• Size: 406 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
## Project Structure

I'm pretty sure I'm the only person that will ever use this thing, so apologies in advance about the short documentation.

* `config/`: Directory containing a config files, written in YAML. There must be one main config file named `.main.yml`. This file is not tracked in source control because it contains sensitive information. Each job process must also have a config file. Then name of the job file corresponds to the job name command line argument when executing one of the main scripts.

* `gtfs/in/`: Directory for CSV files received from a GTFS feed.

* `gtfs/out/`: Directory for CSV files that have been prepared by the script: `prepare_gtfs_files.py`.

* `sql/`: Directory for SQL files:

    * A create tables script for each GTFS feed

    * A routes query extracting the desired API data from staging

    * A stops query extracting the desired API data from staging

* `tpl/`: Directory for template files. For example, SQL query strings that need to be merged with other data before being usable.

* `utils/`: A Python package for some basic utilities shared by the main scripts.

* `prepare_gtfs_files.py`: A script that takes GTFS feed files from `gtfs/in/` and prepares them for import into staging tables. Prepared files are output into the `gtfs/out/` directory.

* `populate_staging_data.py`: A script that imports data from prepared GTFS feed files (`gtfs/out/`) into the staging tables.

* `populate_api_data.py`: A script that performs expensive queries against staging tables to build final output for the api database.