{"id":19106781,"url":"https://github.com/biglocalnews/warn-github-flow","last_synced_at":"2025-04-30T18:04:11.577Z","repository":{"id":39975133,"uuid":"461014886","full_name":"biglocalnews/warn-github-flow","owner":"biglocalnews","description":"GitHub Action workflow for automating a WARN Act notice ETL pipeline","archived":false,"fork":false,"pushed_at":"2025-04-30T14:38:35.000Z","size":1454055,"stargazers_count":7,"open_issues_count":10,"forks_count":0,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-04-30T18:02:57.362Z","etag":null,"topics":["actions","data-journalism","git-scraper","journalism","labor","news","python"],"latest_commit_sha":null,"homepage":"https://biglocalnews.org/content/tools/layoff-watch.html","language":"Makefile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/biglocalnews.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-02-18T21:46:48.000Z","updated_at":"2025-04-29T16:41:17.000Z","dependencies_parsed_at":"2024-01-29T20:30:30.047Z","dependency_job_id":"13f8e61c-373f-44b1-9135-201591ed1bab","html_url":"https://github.com/biglocalnews/warn-github-flow","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/biglocalnews%2Fwarn-github-flow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/biglocalnews%2Fwarn-github-flow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/biglocalnews%2Fwarn-github-flow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/biglocalnews%2Fwarn-github-flow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/biglocalnews","download_url":"https://codeload.github.com/biglocalnews/warn-github-flow/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251758165,"owners_count":21638988,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["actions","data-journalism","git-scraper","journalism","labor","news","python"],"created_at":"2024-11-09T04:09:27.963Z","updated_at":"2025-04-30T18:04:11.559Z","avatar_url":"https://github.com/biglocalnews.png","language":"Makefile","funding_links":[],"categories":[],"sub_categories":[],"readme":"A GitHub Action workflow for automating a WARN Act notice ETL pipeline.\n\n## How it works\n\nThe [extract, transform and load](https://github.com/biglocalnews/warn-github-flow/actions/workflows/etl.yml) Action runs every few hours. It does the following:\n\n- 🔪 Gather raw WARN Act notices from all of our sources with [warn-scraper](https://github.com/biglocalnews/warn-scraper)\n- 🪢 Consolidate the raw files into a single, standardized dataset with [warn-transformer](https://github.com/biglocalnews/warn-transformer)\n- ⏫ Upload the files to our archive on [biglocalnews.org](https://biglocalnews.org) with [upload-files](https://github.com/biglocalnews/upload-files)\n- 📟 Send Slack and Teams alerts\n\n```mermaid\nflowchart TB\n    subgraph Extract\n    A[Scrape sources] --\u003e B[Commit to source-specific branches]\n    B --\u003e C[Upload raw files to biglocalnews.org]\n    end\n    subgraph Transform\n    subgraph Consolidate\n    D[Download raw files from biglocalnews.org] --\u003e E[Merge into a single file]\n    end\n    subgraph Integrate\n        F[Reconcile latest data with current database]\n        F --\u003e G[Identify any additions and amendments]\n    end\n    end\n    subgraph Load\n    H[Commit transformed files to `transformer` branch] --\u003e I[Upload transformed files to biglocalnews.org]\n    end\n    subgraph Alert\n    subgraph Members\n    L[Forward new notices via Slack and Teams bots]\n    end\n    subgraph Administrators\n    J[Post status report to Big Local News Slack]\n    end\n    end\n    Extract --\u003e Transform\n    Consolidate --\u003e Integrate\n    Transform --\u003e Load\n    Load --\u003e Alert\n```\n\n## About\n\nThe project is sponsored by [Big Local News](https://biglocalnews.org/#/about), a program at Stanford University that collects data for impactful journalism. The code is maintained by [Ben Welsh](https://palewi.re/who-is-ben-welsh/), a visiting data journalist from the Los Angeles Times.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbiglocalnews%2Fwarn-github-flow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbiglocalnews%2Fwarn-github-flow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbiglocalnews%2Fwarn-github-flow/lists"}