An open API service indexing awesome lists of open source software.

https://github.com/richardlaugesen/ruvpy

Reference implementation of the Relative Utility Value metric for forecast value assessment
https://github.com/richardlaugesen/ruvpy

climate decision-science environmental-modelling forecast-assessment forecast-evaluation forecast-value forecast-verification forecasting model-validation modelling open-science relative-utility-value ruv verification water weather

Last synced: 3 months ago
JSON representation

Reference implementation of the Relative Utility Value metric for forecast value assessment

Awesome Lists containing this project

README

          

# RUVPY

[![Tests](https://github.com/richardlaugesen/ruvpy/actions/workflows/python-package.yml/badge.svg)](https://github.com/richardlaugesen/ruvpy/actions/workflows/python-package.yml)
![Coverage](https://img.shields.io/badge/dynamic/json?color=green&label=Coverage&query=$.files[%27coverage.json%27].content&url=https://api.github.com/gists/a08622619e06b2157bee092f47e404d9)
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://www.apache.org/licenses/LICENSE-2.0)
[![Contributor Covenant](https://img.shields.io/badge/Contributor%20Covenant-2.1-4baaaa.svg)](CODE_OF_CONDUCT)
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.13939198.svg)](https://doi.org/10.5281/zenodo.13939198)

[Open Science](https://en.wikipedia.org/wiki/Open_science) infrastructure written in [Python](https://python.org/).

RUVPY is a library which can be used in your software to quantify the value of forecast information for decision-making.

It is a reference implementation of the Relative Utility Value (RUV) method, which is very flexible and can accommodate a wide range of decisions.

It includes a set of commonly used decision rules, utility functions, damage functions, and economic models.
The implementation is sufficiently computationally efficient for most situations and optionally parallelises timesteps over available CPU cores (single core by default).
The primary focus of this implementation is clarity and flexibility.

The scope is intentionally narrow and does not include any figure generation, data loading and saving, other metrics, or analysis functionality.
These functions are intended to be implemented in a larger workflow or analysis pipeline which calls the main entry point of this library.

## Publications

The method and software package are introduced in detail in the following publications. We suggest reading these to understand the context and motivation for the software.

*Laugesen, R., Thyer, M., McInerney, D., & Kavetski, D. (2025), Software Library to Quantify the Value of Forecasts for Decision-Making: Case Study on Sensitivity to Damages, Environmental Modelling and Software, https://doi.org/10.1016/j.envsoft.2025.106697*

*Laugesen, R., Thyer, M., McInerney, D., and Kavetski, D. (2023), Flexible forecast value metric suitable for a wide range of decisions: application using probabilistic subseasonal streamflow forecasts, Hydrol. Earth Syst. Sci., 27, 873–893, https://doi.org/10.5194/hess-27-873-2023*

## Installation

The package is available on PyPI and can be installed using pip:

pip install ruvpy

## Documentation

Generated documentation is available at https://richardlaugesen.github.io/ruvpy/ruvpy/.

## Examples

The package includes a set of examples corresponding to each figure in the publications noted above.
These are all implemented as Jupyter notebooks in the `examples` directory.

## Templates

RUV is designed to be tailored to the decision being evaluated.
This may require the development of custom components to define the decision context in RUVPY.
A set of templates to help you get started is included in `templates` directory.

Please consider [contributing](CONTRIBUTING.md) your new components to the repository to help others.

## Development

The main package requires Python (>=3.10), NumPy, SciPy, and Pathos.
The examples additionally require XArray, Pandas, Jupyter, and Matplotlib; the tests require Pytest and Statsmodels,
and generating docs requires pdoc3.

All dependencies are defined in an included pyproject.toml file ready for use with [Poetry](https://python-poetry.org/)
or Setuptools.

For example, once Poetry is installed you can set up the environment with:

poetry install --with dev

You may spawn a new shell with the virtual environment using ``poetry shell``,
or simply prefix commands with ``poetry run``. To run the unit tests:

poetry run pytest

To run the examples you'll need the optional ``examples`` dependencies. Install
them and start Jupyter with:

poetry install -E examples
poetry run jupyter notebook

Regenerate documentation using:

poetry run pdoc --html --output-dir docs ruvpy --force

To release a new version. Ensure everything is up to date and docs are built then bump the version in
the `pyproject.toml` and `CITATION.cff` file. Commit and push to Github before creating a new version tag and
release in the browser. Run `poetry build` and `poetry publish` to push new release to PyPi.

## Attribution

This project is licensed under the [Apache License 2.0](LICENSE), which allows free use, modification, and distribution of the code.

We would like to acknowledge and thank everyone who has helped this project in various ways. Please see the [CONTRIBUTORS](CONTRIBUTORS) file for a full list of individuals.

For proper citation of this project, please refer to the [CITATION.cff](CITATION.cff) file, which provides guidance on
how to cite the software. Please also consider citing the publications listed above.

## Code of conduct

We encourage you to [contribute](CONTRIBUTING.md)! Everyone interacting with this project is expected to follow the [Code of Conduct](CODE_OF_CONDUCT.md).

## Contact

Richard Laugesen ([richard@laugesen.com.au](mailto://richard@laugesen.com.au))