https://github.com/debiai/debiai

Bias detection and contextual evaluation tool for your AI projects
https://github.com/debiai/debiai

ai bias contextual-evaluation data-agnostic data-analysis data-exploration machine-learning model-evaluation plotlyjs python visualization vuejs

Last synced: 6 months ago
JSON representation

Bias detection and contextual evaluation tool for your AI projects

• Host: GitHub
• URL: https://github.com/debiai/debiai
• Owner: debiai
• License: apache-2.0
• Created: 2022-03-01T11:15:47.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2025-07-07T16:13:28.000Z (7 months ago)
• Last Synced: 2025-07-26T21:55:19.490Z (6 months ago)
• Topics: ai, bias, contextual-evaluation, data-agnostic, data-analysis, data-exploration, machine-learning, model-evaluation, plotlyjs, python, visualization, vuejs
• Language: Vue
• Homepage: https://debiai.irt-systemx.fr
• Size: 14.9 MB
• Stars: 28
• Watchers: 5
• Forks: 5
• Open Issues: 53
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

          


    


[![Online documentation](https://img.shields.io/static/v1?label=&message=Online documentation&color=0077de)](https://debiai.irt-systemx.fr/)

[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)

![cd](https://github.com/debiai/debiai/actions/workflows/docker-push.yml/badge.svg)

![Activity](https://img.shields.io/github/commit-activity/m/debiai/debiai)

![Last commit](https://img.shields.io/github/last-commit/debiai/debiai)

[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)

[![Code style: flake8](https://img.shields.io/badge/code%20style-flake8-1c4a6c.svg)](https://flake8.pycqa.org/en/latest/)

[![code style: prettier](https://img.shields.io/badge/code_style-prettier-ff69b4.svg?style=flat-square)](https://github.com/prettier/prettier)



## Why DebiAI?

DebiAI is an open-source web application that aims to facilitate the process of developing Machine Learning models, especially in the stage of the project data analysis and the model performance comparison.

DebiAI provides data scientists with features to:

- Identify biases and errors in your input, results, contextual or ground truth project data

- Make a comparison of the performance of your ML according to their contextual results

- Select and create sets of data graphically for further analysis or (re-)training purposes

- Quickly create and share statistical visualizations of your project data for your team or client

## Documentation

The full documentation is available on the [DebiAI website](https://debiai.irt-systemx.fr/).

## Dashboard

DebiAI has a Web Graphical User Interface with a complete data visualization toolkit offering many statistical analysis tools:



  



The dashboard is highly customizable and can be used for large and small projects. Learn more about the [widgets and how to use them](https://debiai.irt-systemx.fr/dashboard/widgets/).



  

    

  



## Data

DebiAI is designed to be used for any kind of projects and data, it is particularly useful for projects that involve many contextual data.

DebiAI provide two main ways to import your data:

- A [DebiAI Python module](https://debiai.irt-systemx.fr/dataInsertion/pythonModule/) is provided to insert, directly from your Python workflow, the data and model results that you want to study.

- You can also create a [Data Provider](https://debiai.irt-systemx.fr/dataInsertion/dataProviders/), a Web API that will allow DebiAI to reach your data and model results from any programming language and any data sources without duplication.

  Check out the [DebiAI Data Provider Node.js template](https://github.com/debiai/data-provider-nodejs-template) for an example of a Data Provider.

## Installation

DebiAI is available with pip or as a Docker image. To install it, you can follow the [installation guide](https://debiai.irt-systemx.fr/introduction/gettingStarted/installation).

## Use cases

As part of the [Confiance.ai](https://www.confiance.ai/) program, we (the [IRT SystemX](https://www.irt-systemx.fr/)) are using and developing DebiAI for a wide range of use cases.

One of them is the [Valeo - WoodScape](https://woodscape.valeo.com/) dataset:

### Valeo - WoodScape

The Valeo - WoodScape dataset is an annotated image dataset taken from 4 fisheye cameras. DebiAI is used to analyze the dataset for biases and outliers in the data.



  



Within the [Confiance.ai](https://www.confiance.ai/) program, DebiAI has been able to import the project data, detect biases, find annotations errors and export them to the project's image annotation tool.

## Scientific publications

- ICAS 2024 [DebiAI: Open-Source Toolkit for Data Analysis, Visualization and Evaluation in Machine Learning](https://hal.science/hal-04446930).

  - [Best paper award](https://www.iaria.org/conferences2024/AwardsICAS24.html)! 🏆

## Citation

If you use DebiAI in your research, please cite the following paper:

```

@inproceedings{mansion2024debiai,

  title={DebiAI: Open-Source Toolkit for Data Analysis, Visualisation and Evaluation in Machine Learning},

  author={Mansion, Tom and Braud, Rapha{\"e}l and Amrani, Ahmed and Chaouche, Sabrina and Adjed, Faouzi and Cantat, Lo{\"\i}c},

  booktitle={ICAS 2024},

  year={2024}

}

```

---



  DebiAI is developed by 

  

   

  

  And is integrated in 

  

   

  



---