https://github.com/vida-nyu/pycalibrate

pycalibrate is a Python library to visually analyze model calibration in Jupyter Notebooks
https://github.com/vida-nyu/pycalibrate

calibration machine-learning model-analysis model-calibration

Last synced: about 1 month ago
JSON representation

pycalibrate is a Python library to visually analyze model calibration in Jupyter Notebooks

• Host: GitHub
• URL: https://github.com/vida-nyu/pycalibrate
• Owner: VIDA-NYU
• License: mit
• Created: 2022-06-22T03:51:51.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2022-07-02T14:13:28.000Z (over 3 years ago)
• Last Synced: 2025-08-27T11:44:17.655Z (about 2 months ago)
• Topics: calibration, machine-learning, model-analysis, model-calibration
• Language: Jupyter Notebook
• Homepage:
• Size: 7 MB
• Stars: 17
• Watchers: 8
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
[![Downloads](https://static.pepy.tech/personalized-badge/pycalibrate?period=total&units=international_system&left_color=grey&right_color=blue&left_text=Downloads)](https://pepy.tech/project/pycalibrate) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1EBWWy43btgBX-q_pucXtHBOTy-SKerXu?usp=sharing) [![MIT license](https://img.shields.io/badge/License-MIT-blue.svg)](https://github.com/VIDA-NYU/pycalibrate/blob/main/LICENSE)

 ## pycalibrate

 Pycalibrate is a Python package that allows access to the _Calibrate_ tool. Calibrate is a visual analytics tool used to analyze model calibration in Jupyter Notebooks. Below, we show what Calibrate looks like in practice.

## Installation

Installing pycalibrate is easy. Simply run:

```shell

pip install pycalibrate

```

You can also use pycalibrate on Colab, by copying our [Example Colab Notebook](https://colab.research.google.com/drive/1EBWWy43btgBX-q_pucXtHBOTy-SKerXu?usp=sharing).

You can also pip install directly from the repository by running `pip install git+https://github.com/VIDA-NYU/pycalibrate`

## Usage

One can pycalibrate in just a few lines of code:

```python

from pycalibrate import Calibrate

c = Calibrate(data=dataset) # `dataset` must be a Pandas dataframe

c.add_model(y_preds, y_labels, "ModelName") 

# y_preds is an n x k matrix of predictions

# y_labels is an n x k matrix of one-hot encoded labels

c.visualize() # Voila! 

```

## Calibrate Tool

![System screen](https://github.com/VIDA-NYU/pycalibrate/blob/main/images/teaser.png?raw=true)

## Need Help?

Need help? Open up an [issue](https://github.com/VIDA-NYU/pycalibrate/issues).