{"id":21683767,"url":"https://github.com/open-eo/openeo-processes-dask","last_synced_at":"2025-04-06T13:09:27.902Z","repository":{"id":64248296,"uuid":"568816940","full_name":"Open-EO/openeo-processes-dask","owner":"Open-EO","description":"Python implementations of many OpenEO processes, dask-friendly by default.","archived":false,"fork":false,"pushed_at":"2024-12-09T11:05:37.000Z","size":1475,"stargazers_count":19,"open_issues_count":19,"forks_count":14,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-12-12T20:36:56.186Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Open-EO.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":".github/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":".github/CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-11-21T13:24:25.000Z","updated_at":"2024-12-09T11:04:26.000Z","dependencies_parsed_at":"2023-09-22T16:16:06.677Z","dependency_job_id":"51bbd2a9-aaf7-4775-8614-06a01a6b524f","html_url":"https://github.com/Open-EO/openeo-processes-dask","commit_stats":{"total_commits":166,"total_committers":9,"mean_commits":"18.444444444444443","dds":0.5301204819277108,"last_synced_commit":"ca3226a009fc8023959e85cd25d61b53f70bbaf8"},"previous_names":[],"tags_count":71,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-EO%2Fopeneo-processes-dask","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-EO%2Fopeneo-processes-dask/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-EO%2Fopeneo-processes-dask/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Open-EO%2Fopeneo-processes-dask/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Open-EO","download_url":"https://codeload.github.com/Open-EO/openeo-processes-dask/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247485287,"owners_count":20946398,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-25T16:13:27.298Z","updated_at":"2025-04-06T13:09:27.884Z","avatar_url":"https://github.com/Open-EO.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# OpenEO Processes Dask\n\n[![Poetry](https://img.shields.io/endpoint?url=https://python-poetry.org/badge/v0.json)](https://python-poetry.org/)\n![PyPI - Status](https://img.shields.io/pypi/status/openeo-processes-dask)\n![PyPI](https://img.shields.io/pypi/v/openeo-processes-dask)\n![PyPI - Python Version](https://img.shields.io/pypi/pyversions/openeo-processes-dask)\n[![codecov](https://codecov.io/github/Open-EO/openeo-processes-dask/branch/main/graph/badge.svg?token=RA82MUN9RZ)](https://codecov.io/github/Open-EO/openeo-processes-dask)\n\n`openeo-processes-dask` is a collection of Python implementations of [OpenEO processes](https://processes.openeo.org/) based on the [xarray](https://github.com/pydata/xarray)/[dask](https://github.com/dask/dask) ecosystem. It is intended to be used alongside with [openeo-pg-parser-networkx](https://github.com/Open-EO/openeo-pg-parser-networkx), which handles the parsing and execution of [OpenEO process graphs](https://openeo.org/documentation/1.0/developers/api/reference.html#section/Processes/Process-Graphs). There you'll also find a tutorial on how to register process implementations from an arbitrary source (e.g. this repo) to the registry of available processes.\n\n## Installation\nInstall this project via pip:\n\n```\npip install openeo-processes-dask\n```\n\nNote that by default this only installs the json process specs. In order to install the actual implementations, add the `implementations` extra:\n\n```\npip install openeo-processes-dask[implementations]\n```\n\nA subset of process implementations with heavy or unstable dependencies are hidden behind these further build variants:\n- `openeo_processes_dask/process_implementations/ml`: `pip install openeo-processes-dask[ml]`\n- `openeo_processes_dask/process_implementations/experimental`: `pip install openeo-processes-dask[experimental]`\n\n## Development environment\nopeneo-processes-dask requires poetry \u003e1.2, see their [docs](https://python-poetry.org/docs/#installation) for installation instructions.\n\nClone the repository with `--recurse-submodules` to also fetch the process specs:\n```\ngit clone --recurse-submodules git@github.com:Open-EO/openeo-processes-dask.git\n```\n\nTo setup the python venv and install this project into it run:\n```\npoetry install --all-extras\n```\n\nTo add a new core dependency run:\n```\npoetry add some_new_dependency\n```\n\nTo add a new development dependency run:\n```\npoetry add some_new_dependency --group dev\n```\n\nTo run the test suite run:\n```\npoetry run python -m pytest\n```\n\nNote that you can also use the virtual environment that's generated by poetry as the kernel for the ipynb notebooks.\n\n### Pre-commit hooks\n\nThis repo makes use of [pre-commit](https://pre-commit.com/) hooks to enforce linting \u0026 a few sanity checks. In a fresh development setup, install the hooks using `poetry run pre-commit install`. These will then automatically be checked against your changes before making the commit.\n\n### Specs\nThe json specs for the individual processes are tracked as a git submodule in `openeo_processes_dask/specs/openeo-processes`.\nThe raw json for a specific process can be imported using `from openeo_processes_dask.specs import reduce_dimension`.\n\nTo bump these specs to a later version use:\n`git -C openeo_processes_dask/specs/openeo-processes checkout \u003ctag\u003e`\n`git add openeo_processes_dask/specs/openeo-processes`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopen-eo%2Fopeneo-processes-dask","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopen-eo%2Fopeneo-processes-dask","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopen-eo%2Fopeneo-processes-dask/lists"}