{"id":15912460,"url":"https://github.com/debiai/debiai","last_synced_at":"2025-07-31T06:35:04.949Z","repository":{"id":40467211,"uuid":"464861813","full_name":"debiai/DebiAI","owner":"debiai","description":"Bias detection and contextual evaluation tool for your AI projects","archived":false,"fork":false,"pushed_at":"2025-07-07T16:13:28.000Z","size":15673,"stargazers_count":28,"open_issues_count":53,"forks_count":5,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-07-26T21:55:19.490Z","etag":null,"topics":["ai","bias","contextual-evaluation","data-agnostic","data-analysis","data-exploration","machine-learning","model-evaluation","plotlyjs","python","visualization","vuejs"],"latest_commit_sha":null,"homepage":"https://debiai.irt-systemx.fr","language":"Vue","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/debiai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-03-01T11:15:47.000Z","updated_at":"2025-07-07T16:13:32.000Z","dependencies_parsed_at":"2023-09-26T04:52:59.431Z","dependency_job_id":"44bb1370-517a-4685-8ce7-2f21537fcf91","html_url":"https://github.com/debiai/DebiAI","commit_stats":null,"previous_names":[],"tags_count":15,"template":false,"template_full_name":null,"purl":"pkg:github/debiai/DebiAI","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/debiai%2FDebiAI","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/debiai%2FDebiAI/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/debiai%2FDebiAI/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/debiai%2FDebiAI/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/debiai","download_url":"https://codeload.github.com/debiai/DebiAI/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/debiai%2FDebiAI/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267998841,"owners_count":24178631,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-31T02:00:08.723Z","response_time":66,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","bias","contextual-evaluation","data-agnostic","data-analysis","data-exploration","machine-learning","model-evaluation","plotlyjs","python","visualization","vuejs"],"created_at":"2024-10-06T16:04:59.276Z","updated_at":"2025-07-31T06:35:04.918Z","avatar_url":"https://github.com/debiai.png","language":"Vue","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n    \u003cimg src=\"images/DebiAI_logo.svg\" height=\"200\" align=\"\"\u003e\n\n[![Online documentation](https://img.shields.io/static/v1?label=\u0026message=Online documentation\u0026color=0077de)](https://debiai.irt-systemx.fr/)\n\u003c/br\u003e\n[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\n![cd](https://github.com/debiai/debiai/actions/workflows/docker-push.yml/badge.svg)\n\u003c/br\u003e\n![Activity](https://img.shields.io/github/commit-activity/m/debiai/debiai)\n![Last commit](https://img.shields.io/github/last-commit/debiai/debiai)\n\u003c/br\u003e\n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)\n[![Code style: flake8](https://img.shields.io/badge/code%20style-flake8-1c4a6c.svg)](https://flake8.pycqa.org/en/latest/)\n[![code style: prettier](https://img.shields.io/badge/code_style-prettier-ff69b4.svg?style=flat-square)](https://github.com/prettier/prettier)\n\n\u003c/div\u003e\n\n## Why DebiAI?\n\nDebiAI is an open-source web application that aims to facilitate the process of developing Machine Learning models, especially in the stage of the project data analysis and the model performance comparison.\n\nDebiAI provides data scientists with features to:\n\n- Identify biases and errors in your input, results, contextual or ground truth project data\n- Make a comparison of the performance of your ML according to their contextual results\n- Select and create sets of data graphically for further analysis or (re-)training purposes\n- Quickly create and share statistical visualizations of your project data for your team or client\n\n## Documentation\n\nThe full documentation is available on the [DebiAI website](https://debiai.irt-systemx.fr/).\n\n## Dashboard\n\nDebiAI has a Web Graphical User Interface with a complete data visualization toolkit offering many statistical analysis tools:\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"./images/DebiAI_dashboard.png\"\u003e\n\u003c/p\u003e\n\nThe dashboard is highly customizable and can be used for large and small projects. Learn more about the [widgets and how to use them](https://debiai.irt-systemx.fr/dashboard/widgets/).\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/debiai/DebiAI/discussions/categories/show-and-tell\"\u003e\n    \u003cimg src=\"https://img.shields.io/badge/Gallery-Show%20and%20tell-0077de.svg\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## Data\n\nDebiAI is designed to be used for any kind of projects and data, it is particularly useful for projects that involve many contextual data.\n\nDebiAI provide two main ways to import your data:\n\n- A [DebiAI Python module](https://debiai.irt-systemx.fr/dataInsertion/pythonModule/) is provided to insert, directly from your Python workflow, the data and model results that you want to study.\n- You can also create a [Data Provider](https://debiai.irt-systemx.fr/dataInsertion/dataProviders/), a Web API that will allow DebiAI to reach your data and model results from any programming language and any data sources without duplication.\n  Check out the [DebiAI Data Provider Node.js template](https://github.com/debiai/data-provider-nodejs-template) for an example of a Data Provider.\n\n## Installation\n\nDebiAI is available with pip or as a Docker image. To install it, you can follow the [installation guide](https://debiai.irt-systemx.fr/introduction/gettingStarted/installation).\n\n## Use cases\n\nAs part of the [Confiance.ai](https://www.confiance.ai/) program, we (the [IRT SystemX](https://www.irt-systemx.fr/)) are using and developing DebiAI for a wide range of use cases.\n\nOne of them is the [Valeo - WoodScape](https://woodscape.valeo.com/) dataset:\n\n### Valeo - WoodScape\n\nThe Valeo - WoodScape dataset is an annotated image dataset taken from 4 fisheye cameras. DebiAI is used to analyze the dataset for biases and outliers in the data.\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"./images/valeo.png\"\u003e\n\u003c/p\u003e\n\nWithin the [Confiance.ai](https://www.confiance.ai/) program, DebiAI has been able to import the project data, detect biases, find annotations errors and export them to the project's image annotation tool.\n\n## Scientific publications\n\n- ICAS 2024 [DebiAI: Open-Source Toolkit for Data Analysis, Visualization and Evaluation in Machine Learning](https://hal.science/hal-04446930).\n  - [Best paper award](https://www.iaria.org/conferences2024/AwardsICAS24.html)! 🏆\n\n## Citation\n\nIf you use DebiAI in your research, please cite the following paper:\n\n\u003c!-- cSpell:disable --\u003e\n\n```\n@inproceedings{mansion2024debiai,\n  title={DebiAI: Open-Source Toolkit for Data Analysis, Visualisation and Evaluation in Machine Learning},\n  author={Mansion, Tom and Braud, Rapha{\\\"e}l and Amrani, Ahmed and Chaouche, Sabrina and Adjed, Faouzi and Cantat, Lo{\\\"\\i}c},\n  booktitle={ICAS 2024},\n  year={2024}\n}\n```\n\n\u003c!-- cSpell:enable --\u003e\n\n---\n\n\u003cp align=\"center\"\u003e\n  DebiAI is developed by \n  \u003ca href=\"https://www.irt-systemx.fr/\" title=\"IRT SystemX\"\u003e\n   \u003cimg src=\"https://www.irt-systemx.fr/wp-content/uploads/2013/03/system-x-logo.jpeg\"  height=\"70\"\u003e\n  \u003c/a\u003e\n  And is integrated in \n  \u003ca href=\"https://www.confiance.ai/\" title=\"Confiance.ai\"\u003e\n   \u003cimg src=\"https://pbs.twimg.com/profile_images/1443838558549258264/EvWlv1Vq_400x400.jpg\"  height=\"70\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n---\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdebiai%2Fdebiai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdebiai%2Fdebiai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdebiai%2Fdebiai/lists"}