{"id":41623777,"url":"https://github.com/climateimpactlab/pipelines","last_synced_at":"2026-01-24T14:03:44.466Z","repository":{"id":70039928,"uuid":"86859208","full_name":"ClimateImpactLab/pipelines","owner":"ClimateImpactLab","description":"Compute pipelines for GCP","archived":false,"fork":false,"pushed_at":"2018-08-01T05:07:04.000Z","size":9807,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-09-10T03:52:13.327Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ClimateImpactLab.png","metadata":{"files":{"readme":"README.rst","changelog":null,"contributing":"CONTRIBUTING.rst","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2017-03-31T20:48:02.000Z","updated_at":"2018-08-01T05:07:05.000Z","dependencies_parsed_at":"2023-03-25T15:33:05.924Z","dependency_job_id":null,"html_url":"https://github.com/ClimateImpactLab/pipelines","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ClimateImpactLab/pipelines","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ClimateImpactLab%2Fpipelines","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ClimateImpactLab%2Fpipelines/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ClimateImpactLab%2Fpipelines/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ClimateImpactLab%2Fpipelines/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ClimateImpactLab","download_url":"https://codeload.github.com/ClimateImpactLab/pipelines/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ClimateImpactLab%2Fpipelines/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28729411,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-24T10:24:43.181Z","status":"ssl_error","status_checked_at":"2026-01-24T10:24:36.112Z","response_time":89,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-01-24T14:02:30.339Z","updated_at":"2026-01-24T14:03:44.457Z","avatar_url":"https://github.com/ClimateImpactLab.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"=========================================\nClimate Impact Lab Data Pipelines\n=========================================\n\n.. image:: https://travis-ci.org/ClimateImpactLab/pipelines.svg?branch=master\n        :target: https://travis-ci.org/ClimateImpactLab/pipelines?branch=master\n\n.. image:: https://coveralls.io/repos/github/ClimateImpactLab/pipelines/badge.svg?branch=master\n        :target: https://coveralls.io/github/ClimateImpactLab/pipelines?branch=master\n\n.. image:: https://readthedocs.org/projects/pipelines/badge/?version=latest\n        :target: https://pipelines.readthedocs.io/en/latest/?badge=latest\n        :alt: Documentation Status\n\n.. image:: https://pyup.io/repos/github/ClimateImpactLab/pipelines/shield.svg\n        :target: https://pyup.io/repos/github/ClimateImpactLab/pipelines/\n        :alt: Updates\n\n\nThe ``pipelines`` package is the place to request, test, and submit jobs at the\nClimate Impact Lab. For help submitting a job, see our \n`docs \u003chttps://pipelines.readthedocs.io/en/latest/\u003e`_ or ask Justin.\n\nFeatures\n--------\n\n* Tested reshape operations on climate data\n* A template for more portions of our pipeline\n\n\nUsage\n-----\n\n1.  Create a new branch for your request (``git branch my-new-run``)\n\n2.  In the relevant sector's submodule (e.g. ``pipelines/climate``), look for a template job, e.g. ``/pipelines/climate/jobs/job_bcsd_template.py``\n\n2.  Copy this template to a directory for your project (e.g. ``gcp-labor`` or ``impactlab_website``)\n\n3.  Make sure this folder has an ``__init__.py`` file in it. It can be blank.\n\n4.  Modify the template to your needs. If you need a new transformation, create one in ``transformations.py``\n\n5.  Initialize your pipelines by importing your file, e.g.: \n\n    .. code-block:: python\n  \n        python -m pipelines.climate.jobs.impactlab_website.my_new_job\n\n6.  Run tests: ``pytest``\n\n7.  Push your changes to github and file a pull request\n\n\nRequirements\n------------\n\nFor now, pipelines requires python 2.7. We're working on 3x support.\n\n\nTodo\n----\n\nSee `issues \u003chttps://github.com/ClimateImpactLab/pipelines/issues\u003e`_ to see and add to our todos.\n\n\nCredits\n---------\n\nThis package was created by `Justin Simcock \u003chttps://github.com/jgerardsimcock\u003e`_ and `Michael Delgado \u003chttps://github.com/delgadom\u003e`_ of the `Climate Impact Lab \u003chttp://impactlab.org\u003e`_. Check us out on `github \u003chttps://github.com/ClimateImpactLab\u003e`_.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fclimateimpactlab%2Fpipelines","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fclimateimpactlab%2Fpipelines","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fclimateimpactlab%2Fpipelines/lists"}