https://github.com/jfcrenshaw/pzflow

Probabilistic modeling of tabular data with normalizing flows.
https://github.com/jfcrenshaw/pzflow

Last synced: 3 months ago
JSON representation

Probabilistic modeling of tabular data with normalizing flows.

• Host: GitHub
• URL: https://github.com/jfcrenshaw/pzflow
• Owner: jfcrenshaw
• License: mit
• Created: 2021-01-07T04:01:29.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2024-06-17T22:56:27.000Z (5 months ago)
• Last Synced: 2024-07-21T14:05:53.893Z (4 months ago)
• Language: Python
• Homepage: https://jfcrenshaw.github.io/pzflow/
• Size: 24.1 MB
• Stars: 53
• Watchers: 2
• Forks: 12
• Open Issues: 17
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/contributing.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-normalizing-flows - pzflow

README

        
![build](https://github.com/jfcrenshaw/pzflow/workflows/build/badge.svg)

[![codecov](https://codecov.io/gh/jfcrenshaw/pzflow/branch/main/graph/badge.svg?token=qR5cey0swQ)](https://codecov.io/gh/jfcrenshaw/pzflow)

[![PyPI version](https://badge.fury.io/py/pzflow.svg)](https://badge.fury.io/py/pzflow)

[![DOI](https://zenodo.org/badge/327498448.svg)](https://zenodo.org/badge/latestdoi/327498448)

[![Docs](https://img.shields.io/badge/Docs-https%3A%2F%2Fjfcrenshaw.github.io%2Fpzflow%2F-red)](https://jfcrenshaw.github.io/pzflow/)

# PZFlow

PZFlow is a python package for probabilistic modeling of tabular data with normalizing flows.

If your data consists of continuous variables that can be put into a Pandas DataFrame, pzflow can model the joint probability distribution of your data set.

The `Flow` class makes building and training a normalizing flow simple.

It also allows you to easily sample from the normalizing flow (e.g., for forward modeling or data augmentation), and calculate posteriors over any of your variables.

There are several tutorial notebooks in the [docs](https://jfcrenshaw.github.io/pzflow/tutorials/).

## Installation

See the instructions in the [docs](https://jfcrenshaw.github.io/pzflow/install/).

## Citation

If you use this package in your research, please cite the following two sources:

The paper

```bibtex

@misc{crenshaw2024,

      title={Probabilistic Forward Modeling of Galaxy Catalogs with Normalizing Flows}, 

      author={John Franklin Crenshaw and J. Bryce Kalmbach and Alexander Gagliano and Ziang Yan and Andrew J. Connolly and Alex I. Malz and Samuel J. Schmidt and The LSST Dark Energy Science Collaboration},

      year={2024},

      eprint={2405.04740},

      archivePrefix={arXiv},

      primaryClass={astro-ph.IM}

}

```

The Zenodo deposit

```bibtex

@software{pzflow,

  author       = {Crenshaw, John Franklin and

                  Yan, Ziang and

                  Doster, Vlad},

  title        = {jfcrenshaw/pzflow: v3.1.3},

  month        = feb,

  year         = 2024,

  publisher    = {Zenodo},

  version      = {v3.1.3},

  doi          = {10.5281/zenodo.10710271},

  url          = {https://doi.org/10.5281/zenodo.10710271}

}

```

### Sources

PZFlow was originally designed for forward modeling of photometric redshifts as a part of the Creation Module of the [DESC](https://lsstdesc.org/) [RAIL](https://github.com/LSSTDESC/RAIL) project.

The idea to use normalizing flows for photometric redshifts originated with [Bryce Kalmbach](https://github.com/jbkalmbach).

The earliest version of the normalizing flow in RAIL was based on a notebook by [Francois Lanusse](https://github.com/eiffl) and included contributions from [Alex Malz](https://github.com/aimalz).

The functional jax structure of the bijectors was originally based on [`jax-flows`](https://github.com/ChrisWaites/jax-flows) by [Chris Waites](https://github.com/ChrisWaites). The implementation of the Neural Spline Coupling is largely based on the [Tensorflow implementation](https://github.com/tensorflow/probability/blob/master/tensorflow_probability/python/bijectors/rational_quadratic_spline.py), with some inspiration from [`nflows`](https://github.com/bayesiains/nflows/).

Neural Spline Flows are based on the following papers:

  > [NICE: Non-linear Independent Components Estimation](https://arxiv.org/abs/1410.8516)\

  > Laurent Dinh, David Krueger, Yoshua Bengio\

  > _arXiv:1410.8516_

  > [Density estimation using Real NVP](https://arxiv.org/abs/1605.08803)\

  > Laurent Dinh, Jascha Sohl-Dickstein, Samy Bengio\

  > _arXiv:1605.08803_

  > [Neural Spline Flows](https://arxiv.org/abs/1906.04032)\

  > Conor Durkan, Artur Bekasov, Iain Murray, George Papamakarios\

  > _arXiv:1906.04032_