{"id":50569515,"url":"https://github.com/cityofaustin/atd-data-publishing","last_synced_at":"2026-06-04T17:03:59.728Z","repository":{"id":45306071,"uuid":"67241163","full_name":"cityofaustin/atd-data-publishing","owner":"cityofaustin","description":"Python scripts for Austin Transportation's ETL tasks","archived":false,"fork":false,"pushed_at":"2023-01-31T22:26:56.000Z","size":708,"stargazers_count":13,"open_issues_count":0,"forks_count":3,"subscribers_count":13,"default_branch":"production","last_synced_at":"2024-06-11T16:09:24.072Z","etag":null,"topics":["bcycle","docker","intelligent-transportation-systems","mobility","open-data","python","transportation"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cityofaustin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-09-02T17:13:50.000Z","updated_at":"2023-01-14T12:14:42.000Z","dependencies_parsed_at":"2023-02-06T08:31:42.758Z","dependency_job_id":null,"html_url":"https://github.com/cityofaustin/atd-data-publishing","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/cityofaustin/atd-data-publishing","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cityofaustin%2Fatd-data-publishing","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cityofaustin%2Fatd-data-publishing/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cityofaustin%2Fatd-data-publishing/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cityofaustin%2Fatd-data-publishing/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cityofaustin","download_url":"https://codeload.github.com/cityofaustin/atd-data-publishing/tar.gz/refs/heads/production","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cityofaustin%2Fatd-data-publishing/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33914631,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-04T02:00:06.755Z","response_time":64,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bcycle","docker","intelligent-transportation-systems","mobility","open-data","python","transportation"],"created_at":"2026-06-04T17:03:59.672Z","updated_at":"2026-06-04T17:03:59.723Z","avatar_url":"https://github.com/cityofaustin.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# transportation-data-publishing\n\nThis repo houses ETL scripts for Austin Transportation's data integration projects. They're written in Python. \n\n## Quick Start\n\n1. Clone this repository to your host: `git clone https://github.com/cityofaustin/transportation-data-publishing`\n \n2. Create your `secrets.py` and drop it into `transportation-data-publishing/config` following the template in [fake-secrets.py](https://github.com/cityofaustin/transportation-data-publishing/blob/master/config/fake_secrets.py)\n\n3. If setting up ESB inegration add certificates to `transportation-data-publishing/config/esb`\n\n4. Run scripts as needed, or deploy to a Docker host with [transportation-data-deploy](http://github.com/cityofaustin/transportation-data-deploy)\n\n## About the Repo Structure\n\n#### [bcycle](https://github.com/cityofaustin/transportation-data-publishing/tree/master/transportation-data-publishing/bcycle)\n\nThese scripts load B-Cycle tripe data from an Austin B-Cycle Dropbox folder to [data.austintexas.gov](http://data.austintexas.gov).\n\n#### [config](https://github.com/cityofaustin/transportation-data-publishing/tree/master/transportation-data-publishing/config)\n\nConfig holds configuration files needed for the various scripts. `secrets.py` belongs here -- see `fake_secrets.py` as a reference.\n\n#### [data_tracker](https://github.com/cityofaustin/transportation-data-publishing/tree/master/transportation-data-publishing/data_tracker)\n\nThese scripts modify data in our Data Tracker application, and support its integration with other applications.\n\n#### [open_data](https://github.com/cityofaustin/transportation-data-publishing/tree/master/transportation-data-publishing/open_data)\n\nThese scripts publish transportation data to [data.austintexas.gov](http://data.austintexas.gov) and the City's ArcGIS Online organization site.\n\n#### [traffic_study](https://github.com/cityofaustin/transportation-data-publishing/tree/master/transportation-data-publishing/traffic_study)\n\nThese are the dedicated files for publishing traffic study data, as described [in the wiki](https://github.com/cityofaustin/transportation-data-publishing/wiki/Traffic-Count-Data-Publishing).\n\n## Contributing\n\nPublic contributions are welcome! Assign pull requests to [@johnclary](http://github.com/johnclary).\n\n## Deployment Pipeline\n\nWe are currently using CircleCI to automatically rebuild the container on every update to this repo, and autonomously deploy that image to Docker-hub. When working in the production or master branches, there are some considerations to keep in mind:\n\n- You will need someone to review your changes for Production or Master branches.\n- The production branch is tagged as `latest` in dockerhub, which means it will be the default image and \"source of truth\".\n- Ideally you will want to merge to master, which will cause CircleCI to create a `master` tag in dockerhub, which can be used for additional testing or troubleshooting.\n- Any code merged to production, should be production-worthy already. Test thoroughly in master or any other branch before merging in any additional code.\n\n### Development\n\nFeel free to create a new branch, and commit/push as many times as you need. The pipeline will create a new docker image (if it does not exist), or update the existing image in dockerhub. *Your branch name will be used as the identifying tag in docker hub.*\n\n**For example:**\n\nSay you create a branch with the name `123-atd-updatedcode`, as soon as the branch is created CircleCI will begin building the docker image, and tag it as `atddocker/atd-data-publishing:123-atd-updatedcode` , then it will upload it to Docker hub. If there is already an image with that tag, it will simply update it.\n\n\n\n## License\n\nAs a work of the City of Austin, this project is in the public domain within the United States.\n\nAdditionally, we waive copyright and related rights in the work worldwide through the [CC0 1.0 Universal public domain dedication](https://creativecommons.org/publicdomain/zero/1.0/).\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcityofaustin%2Fatd-data-publishing","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcityofaustin%2Fatd-data-publishing","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcityofaustin%2Fatd-data-publishing/lists"}