{"id":17530995,"url":"https://github.com/danp/outages-to-sqlite","last_synced_at":"2026-02-15T09:38:04.999Z","repository":{"id":66584254,"uuid":"332518828","full_name":"danp/outages-to-sqlite","owner":"danp","description":"Convert scraped NS Power outage data to a SQLite database","archived":false,"fork":false,"pushed_at":"2025-03-01T19:18:50.000Z","size":2367,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-09-29T09:34:41.388Z","etag":null,"topics":["geojson","git-scraping","golang","sqlite"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/danp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-01-24T18:03:29.000Z","updated_at":"2025-03-01T19:18:54.000Z","dependencies_parsed_at":"2025-04-13T18:47:54.425Z","dependency_job_id":null,"html_url":"https://github.com/danp/outages-to-sqlite","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/danp/outages-to-sqlite","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danp%2Foutages-to-sqlite","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danp%2Foutages-to-sqlite/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danp%2Foutages-to-sqlite/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danp%2Foutages-to-sqlite/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/danp","download_url":"https://codeload.github.com/danp/outages-to-sqlite/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danp%2Foutages-to-sqlite/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29474843,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-15T06:58:05.414Z","status":"ssl_error","status_checked_at":"2026-02-15T06:58:05.085Z","response_time":118,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["geojson","git-scraping","golang","sqlite"],"created_at":"2024-10-20T17:14:13.199Z","updated_at":"2026-02-15T09:38:04.973Z","avatar_url":"https://github.com/danp.png","language":"Go","readme":"# outages-to-sqlite\n\nA very work-in-progress program to convert\n[scraped Nova Scotia Power outage data](https://github.com/danp/nspoweroutages)\nto a [SQLite](https://sqlite.org) database.\n\nThe result is currently visible at https://nsp.datasette.danp.net/outages\n(powered by [Datasette](https://datasette.io)).\n\nIn short, this program:\n\n1. Reads each commit of https://github.com/danp/nspoweroutages, cloning it in memory by default, can be configured with `-repo-remote \u003cremote\u003e` or `-repo-path \u003cpath\u003e`\n1. Parses the `data/outages.json` file\n1. Uses the `geom.p` value (which every outage seems to have) as a key to determine which outages are new, ongoing, or gone\n1. Uses data in the [places](places) directory to map the `geom.p` value to a place (currently at the \"county\" level)\n1. Emits events to a sqlite database, `outages.db` by default but can be specified with `-database-file \u003cpath\u003e`\n\nOnce the database exists, subsequent runs will fetch the last observed time from the database and\nread commits from then on, picking up where it left off.\n\nEverything about this is subject to change!\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanp%2Foutages-to-sqlite","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdanp%2Foutages-to-sqlite","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanp%2Foutages-to-sqlite/lists"}