https://github.com/casangi/graphviper

Dask Based MapReduce for Multi Xarray Datasets.
https://github.com/casangi/graphviper

dask mapreduce xarray zarr

Last synced: 5 months ago
JSON representation

Dask Based MapReduce for Multi Xarray Datasets.

• Host: GitHub
• URL: https://github.com/casangi/graphviper
• Owner: casangi
• License: other
• Created: 2023-11-08T20:11:07.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2026-01-12T21:17:04.000Z (5 months ago)
• Last Synced: 2026-01-12T21:33:28.202Z (5 months ago)
• Topics: dask, mapreduce, xarray, zarr
• Language: Python
• Homepage: https://graphviper.readthedocs.io/
• Size: 2.79 MB
• Stars: 1
• Watchers: 5
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

          
# GraphVIPER

[![Python 3.11 3.12 3.13](https://img.shields.io/badge/python-3.11%20%7C%203.12%20%7C%203.13-blue)](https://www.python.org/downloads/release/python-3130/)

[![Linux Tests](https://github.com/casangi/graphviper/actions/workflows/python-testing-linux.yml/badge.svg?branch=main)](https://github.com/casangi/graphviper/actions/workflows/python-testing-linux.yml?query=branch%3Amain)

[![macOS Tests](https://github.com/casangi/graphviper/actions/workflows/python-testing-macos.yml/badge.svg?branch=main)](https://github.com/casangi/graphviper/actions/workflows/python-testing-macos.yml?query=branch%3Amain)

[![ipynb Tests](https://github.com/casangi/graphviper/actions/workflows/run-ipynb.yml/badge.svg?branch=main)](https://github.com/casangi/graphviper/actions/workflows/run-ipynb.yml?query=branch%3Amain)

[![Coverage](https://codecov.io/gh/casangi/graphviper/branch/main/graph/badge.svg)](https://codecov.io/gh/casangi/graphviper/branch/main/graphviper)

[![Documentation Status](https://readthedocs.org/projects/graphviper/badge/?version=latest)](https://graphviper.readthedocs.io)

[![Version Status](https://img.shields.io/pypi/v/graphviper.svg)](https://pypi.python.org/pypi/graphviper/)

GraphVIPER (Visibility and Image Parallel Execution Reduction) is a [Dask](https://docs.dask.org/) based MapReduce package. It allows for mapping a dictionary of [xarray.Dataset](https://docs.xarray.dev/en/stable/generated/xarray.Dataset.html)s to [Dask graph nodes](https://docs.dask.org/en/latest/graphs.html) followed by a reduce step.

**GraphVIPER is in development and breaking API changes will happen.**

The best place to start with GraphVIPER is doing the [graph building tutorial](https://graphviper.readthedocs.io/en/latest/graph_building_tutorial.html).