{"id":26941472,"url":"https://github.com/benjamin-heasly/proceed","last_synced_at":"2025-04-02T16:19:50.703Z","repository":{"id":70783154,"uuid":"598799452","full_name":"benjamin-heasly/proceed","owner":"benjamin-heasly","description":"Declarative file processing with YAML and containers","archived":false,"fork":false,"pushed_at":"2025-03-28T18:16:49.000Z","size":251,"stargazers_count":0,"open_issues_count":10,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-28T19:23:21.267Z","etag":null,"topics":["containers","docker","pipelines","python","yaml"],"latest_commit_sha":null,"homepage":"https://benjamin-heasly.github.io/proceed/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"unlicense","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/benjamin-heasly.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-02-07T20:40:25.000Z","updated_at":"2025-03-28T18:16:53.000Z","dependencies_parsed_at":"2024-08-06T23:38:46.080Z","dependency_job_id":"7430c4eb-34ef-401b-a163-a7c620a23992","html_url":"https://github.com/benjamin-heasly/proceed","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/benjamin-heasly%2Fproceed","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/benjamin-heasly%2Fproceed/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/benjamin-heasly%2Fproceed/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/benjamin-heasly%2Fproceed/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/benjamin-heasly","download_url":"https://codeload.github.com/benjamin-heasly/proceed/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246837683,"owners_count":20841903,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["containers","docker","pipelines","python","yaml"],"created_at":"2025-04-02T16:19:50.259Z","updated_at":"2025-04-02T16:19:50.697Z","avatar_url":"https://github.com/benjamin-heasly.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Proceed\nDeclarative file processing with YAML and containers.\n\n**Proceed** is a Python library and CLI tool for declarative batch processing.\nIt reads a **pipeline** specification declared in [YAML](https://yaml.org/).\nA pipeline contains a list of **steps** that are based on [Docker](https://www.docker.com/) images and containers.\n\nEach pipeline execution accepts values for declared **args**, allowing controlled, explicit configuration of steps at runtime.\nEach execution produces an **execution record** that accounts for accepted arg values, step logs, and checksums of input and output files.\n\nHopefully, Proceed will allow you to express everything you need to know about your processing pipeline in a *\"nothing up my sleeves\"* way.  The pipeline specification should be complete enough to share with others who have Proceed and Docker installed.\nThe execution record should allow for auditing of expected outcomes and reproducibility.\n\n## docs\nHere are the [main docs](https://benjamin-heasly.github.io/proceed/index.html) for Proceed.\n\n# Installation\nProceed requires [Python](https://www.python.org/) and [Docker](https://www.docker.com/) to be installed.\nWith those, it should be able to run a wide variety pipelines and steps via containers.\n\n## pip\nProceed itself is available on [PyPI](https://pypi.org/project/proceed/).\nThis is the recommended way to install Proceed:\n\n```\n$ pip install proceed\n```\n\n## git and pip\nYou can also install Proceed from source.\n\n```\n$ pip install git+https://https://github.com/benjamin-heasly/proceed.git\n\n# editable mode\n$ git checkout https://github.com/benjamin-heasly/proceed.git\n$ pip install -e ./proceed\n```\n\n## check installation\nYou can check if Proceed installed correctly using the `proceed` command.\n\n```\n$ proceed --version\nProceed x.y.z\n\n$ proceed --help\nusage etc...\n```\n\n## development and testing\n\nYou can set up a development environment with [conda](https://conda.io/projects/conda/en/latest/user-guide/install/index.html) and [dev-environment.yml](./dev-environment.yml).\n\n```\nconda env create -f dev-environment.yml\n# or\nconda env update -f dev-environment.yml\n```\n\nWith that, you should be able to run through the Proceed unit and integration tests.\n\n```\nconda activate proceed-dev\nhatch run test:cov\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbenjamin-heasly%2Fproceed","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbenjamin-heasly%2Fproceed","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbenjamin-heasly%2Fproceed/lists"}