An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with explainability

A curated list of projects in awesome lists tagged with explainability .

https://github.com/shap/shap

A game theoretic approach to explain the output of any machine learning model.

deep-learning explainability gradient-boosting interpretability machine-learning shap shapley

Last synced: 11 Dec 2025

https://github.com/maif/shapash

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

ethical-artificial-intelligence explainability explainable-ml interpretability lime machine-learning python shap transparency

Last synced: 30 Jan 2026

https://github.com/MAIF/shapash

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

ethical-artificial-intelligence explainability explainable-ml interpretability lime machine-learning python shap transparency

Last synced: 26 Mar 2025

https://github.com/hila-chefer/transformer-explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

attention-matrix attention-visualization bert bert-model cvpr2021 deep-learning explainability perturbation transformer-interpretability vision-transformer visualize-classifications vit

Last synced: 15 May 2025

https://github.com/hila-chefer/Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

attention-matrix attention-visualization bert bert-model cvpr2021 deep-learning explainability perturbation transformer-interpretability vision-transformer visualize-classifications vit

Last synced: 27 Mar 2025

https://github.com/microsoft/responsible-ai-toolbox

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

data-analysis data-science data-visualization error-analysis explainability explainable-ai explainable-ml fairness fairness-ai fairness-ml interpretability jupyter machine-learning machinelearning ml responsible-ai ui visualization widget widgets

Last synced: 13 May 2025

https://github.com/hila-chefer/transformer-mm-explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 12 Apr 2025

https://github.com/hila-chefer/Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 03 Apr 2025

https://github.com/MisaOgura/flashtorch

Visualization toolkit for neural networks in PyTorch! Demo -->

cnn deep-learning explainability interpretability machine-learning neural-networks pytorch visualization

Last synced: 27 Mar 2025

https://github.com/explainx/explainx

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code. We are looking for co-authors to take this project forward. Reach out @ ms8909@nyu.edu

aws-sagemaker bias blackbox explainability explainable-ai explainable-artificial-intelligence explainable-ml explainx interpretability interpretable-ai interpretable-machine-learning machine-learning machine-learning-interpretability scikit-learn transparency xai

Last synced: 16 May 2025

https://github.com/explainX/explainx

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code. We are looking for co-authors to take this project forward. Reach out @ ms8909@nyu.edu

aws-sagemaker bias blackbox explainability explainable-ai explainable-artificial-intelligence explainable-ml explainx interpretability interpretable-ai interpretable-machine-learning machine-learning machine-learning-interpretability scikit-learn transparency xai

Last synced: 04 Apr 2025

https://github.com/xmed-lab/CLIP_Surgery

CLIP Surgery for Better Explainability with Enhancement in Open-Vocabulary Tasks

clip explainability interpretability multilabel multimodal open-vocabulary sam segment-anything segmentation vision-transformer

Last synced: 16 Mar 2025

https://github.com/iancovert/sage

For calculating global feature importance using Shapley values.

explainability interpretability machine-learning shapley

Last synced: 26 Mar 2025

https://github.com/AI4LIFE-GROUP/OpenXAI

OpenXAI : Towards a Transparent Evaluation of Model Explanations

benchmark explainability explainable-ai interpretability leaderboard reproducibility

Last synced: 28 Apr 2025

https://github.com/chr5tphr/zennit

Zennit is a high-level framework in Python using PyTorch for explaining/exploring neural networks using attribution methods like LRP.

attribution deep-learning explainability explainable-ai feature-attribution interpretability interpretable-ai interpretable-ml lrp machine-learning python pytorch xai

Last synced: 09 Apr 2025

https://github.com/squaredev-io/whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

accuracy accuracy-metrics accuracy-score confusion-matrix explainability explainable-ai f1-score k8s kubernetes machine-learning ml-monitoring mlflow mlops model-monitoring modelops monitoring observability python recall xai

Last synced: 17 Jan 2026

https://github.com/feedzai/timeshap

TimeSHAP explains Recurrent Neural Network predictions.

explainability rnn shap shapley-values

Last synced: 05 Apr 2025

https://github.com/hila-chefer/robustvit

[NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows to finetune the explainability maps of Vision Transformers to enhance robustness.

explainability neurips neurips-2022 robustness vision-transformer

Last synced: 13 Oct 2025

https://github.com/hila-chefer/RobustViT

[NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows to finetune the explainability maps of Vision Transformers to enhance robustness.

explainability neurips neurips-2022 robustness vision-transformer

Last synced: 08 May 2025

https://github.com/baldassarrefe/graph-network-explainability

Explainability techniques for Graph Networks, applied to a synthetic dataset and an organic chemistry task. Code for the workshop paper "Explainability Techniques for Graph Convolutional Networks" (ICML19)

artificial-intelligence bioinformatics explainability graph-networks

Last synced: 18 Mar 2025

https://github.com/d909b/cxplain

Causal Explanation (CXPlain) is a method for explaining the predictions of any machine-learning model.

deep-learning explainability explainable-ai explainable-ml interpretability machine-learning

Last synced: 17 Sep 2025

https://github.com/givasile/effector

Effector - a Python package for global and regional effect methods

explainability iml xai

Last synced: 05 Apr 2026

https://github.com/snehankekre/streamlit-shap

streamlit-shap provides a wrapper to display SHAP plots in Streamlit.

explainability interpretability machine-learning shap shapley streamlit streamlit-component

Last synced: 21 Aug 2025

https://github.com/SAP-archive/contextual-ai

Contextual AI adds explainability to different stages of machine learning pipelines - data, training, and inference - thereby addressing the trust gap between such ML systems and their users. It does not refer to a specific algorithm or ML method — instead, it takes a human-centric view and approach to AI.

explainability machine-learning report-generator

Last synced: 18 Jul 2025

https://github.com/mertyg/post-hoc-cbm

Code for the paper "Post-hoc Concept Bottleneck Models". Spotlight @ ICLR 2023

concept-based-explanations concept-based-models concepts explainability interpretability

Last synced: 04 Sep 2025

https://github.com/hila-chefer/conceptor

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 03 Jul 2025

https://github.com/fat-forensics/fat-forensics

Modular Python Toolbox for Fairness, Accountability and Transparency Forensics

accountability explainability explainable-ai fairness interpretability interpretable-ai machine-learning transparency

Last synced: 27 Mar 2025

https://github.com/hila-chefer/Conceptor

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 27 Mar 2025

https://hila-chefer.github.io/Conceptor/

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 27 Mar 2025

https://github.com/deel-ai/influenciae

👋 Influenciae is a Tensorflow Toolbox for Influence Functions

explainability explainable-ai fairness-ai influence-functions misclassification outlier-detection

Last synced: 16 May 2025

https://github.com/chirag-agarwall/VOG

Estimating Example Difficulty using Variance of Gradients

atypical-examples deep-learning explainability human-in-the-loop-auditing interpretability

Last synced: 08 May 2025

https://github.com/linkedin/te2rules

Python library to explain Tree Ensemble models (TE) like XGBoost, using a rule list.

explainability explainable-ai interpretability interpretable-ai machine-learning random-forest rule-learning tree-ensembles xgboost

Last synced: 01 Mar 2026

https://github.com/serre-lab/harmonization

👋 Aligning Human & Machine Vision using explainability

deep-learning explainability explainable-ai interpretability machine-learning neuroscience

Last synced: 08 Aug 2025

https://github.com/tjiagoM/spatio-temporal-brain

A Deep Graph Neural Network Architecture for Modelling Spatio-temporal Dynamics in rs-fMRI Data

explainability fmri gnn temporal-convolutional-network wandb-agent

Last synced: 01 May 2025

https://github.com/florianwilhelm/lda4rec

🧮 Extended Latent Dirichlet Allocation for Collaborative Filtering in Recommender Systems.

collaborative-filtering explainability interpretability python recommender-system

Last synced: 15 Sep 2025

https://github.com/yc015/scene-representation-diffusion-model

Linear probe found representations of scene attributes in a text-to-image diffusion model

explainability image-editing interpretability scene stable-diffusion

Last synced: 20 Jan 2026

https://github.com/zbr17/AVSL

[CVPR 2022] Official PyTorch implementation for Attributable Visual Similarity Learning

explainability metric-learning similarity-learning

Last synced: 08 May 2025

https://github.com/microsoft/responsible-ai-workshop

Responsible AI Workshop: a series of tutorials & walkthroughs to illustrate how put responsible AI into practice

error-analysis explainability explainable-ai explainable-ml fairness fairness-ai fairness-ml jupyter-notebook machine-learning ml mlops-workshop principles responsible-ai widgets

Last synced: 16 Mar 2026

https://github.com/cloudera/cml_amp_explainability_lime_shap

Learn how to explain ML models using LIME and SHAP.

explainability interpretability lime shap

Last synced: 13 Apr 2025

https://github.com/lexsi-labs/dlbacktrace

DL Backtrace is a new explainablity technique for deep learning models that works for any modality and model type.

deep-learning explainability xai

Last synced: 13 Apr 2026

https://github.com/agamiko/gebi

GEBI: Global Explanations for Bias Identification. Open source code for discovering bias in data with skin lesion dataset

attention-maps deep-learning explainability explainable-ai global-explanation

Last synced: 14 Apr 2025

https://github.com/hi-paris/xper

A methodology designed to measure the contribution of the features to the predictive performance of any econometric or machine learning model.

explainability interpretability machine-learning performance-metrics shap shapley-value

Last synced: 09 Apr 2026

https://github.com/AgaMiko/GEBI

GEBI: Global Explanations for Bias Identification. Open source code for discovering bias in data with skin lesion dataset

attention-maps deep-learning explainability explainable-ai global-explanation

Last synced: 19 Apr 2025

https://github.com/cloudera/cml_amp_churn_prediction

Build an scikit-learn model to predict churn using customer telco data.

churn-prediction explainability interpretability lime logistic-regression

Last synced: 13 Apr 2025

https://github.com/capitalone/ablation

Evaluating XAI methods through ablation studies.

ablation explainability ground-truth xai

Last synced: 01 Sep 2025

https://github.com/bramucas/xclingo2

A tool for explainability and debugging in Answer Set Programming.

answer-set-programming debugging-tool explainability logic-programming

Last synced: 02 Apr 2026

https://github.com/kohlerhector/interpreter-py

Implementation of Interpretable and Editable Programmatic Tree Policies for Reinforcement Learning (Kohler, Delfosse, et. al. 2024).

code-generation explainability explainable-ai imitation-learning interpretability mujoco program-generation programmatic reinforcement-learning

Last synced: 09 Mar 2026

https://github.com/basics-lab/spectral-explain

Fast XAI with interactions at large scale. SPEX can help you understand the output of your LLM, even if you have a long context!

explainability explainable-ai llm-interpretability shap sparse-transformer xai

Last synced: 17 Mar 2026

https://github.com/chinefed/convolutional-set-transformer

Official implementation of the Convolutional Set Transformer (Chinello & Boracchi, 2025). This repository includes the source code of the cstmodels Python package, which provides reusable Keras 3 layers for constructing CST architectures, together with an interface to load and use the CST-15 model pre-trained on ImageNet.

anomaly-detection computer-vision convolutional-set-transformer deep-learning explainability image-classification set-learning transfer-learning

Last synced: 14 Jan 2026

https://github.com/warisgill/tracefl

TraceFL is a novel mechanism for Federated Learning that achieves interpretability by tracking neuron provenance. It identifies clients responsible for global model predictions, achieving 99% accuracy across diverse datasets (e.g., medical imaging) and neural networks (e.g., GPT).

accountability debugging differential-privacy explainability explainable-ai federated-learning interpretability interpretability-and-explainability machine-learning software-engineering testing

Last synced: 26 Jun 2025

https://github.com/andreabac3/study-transfer-learning-covid-19

This repository contains the official code of the research paper Study on transfer learning capabilities for pneumonia classification in chest-x-rays images pubblished at the Computer Methods and Programs in Biomedicine Journal.

computer-vision covid cv explainability explainable-ai pytorch pytorch-lightning torch

Last synced: 09 Nov 2025

https://github.com/bgreenwell/statlingua

Explain Statistical Output with Large Language Models

data-science explainability large-language-models llm llms statistics teaching-tools

Last synced: 28 Feb 2026

https://github.com/avoss84/bayes-anomaly

A Python library for explainable Bayesian Anomaly Detection

anomaly-detection bayesian-inference explainability unsupervised-machine-learning

Last synced: 10 Apr 2025

https://github.com/AVoss84/bayes-anomaly

A Python library for explainable Bayesian Anomaly Detection

anomaly-detection bayesian-inference explainability unsupervised-machine-learning

Last synced: 12 Apr 2025

https://github.com/kiegroup/trusty-ai-sandbox

A sandbox repository for the Trusty AI team

dmn explainability hacktoberfest kogito trustyai

Last synced: 27 Dec 2025

https://github.com/cifkao/context-probing

Black-box language model explanation by context length probing

acl2023 explainability transformers

Last synced: 15 Apr 2025

https://github.com/aimaster-dev/default_loan_prediction

This project automates bank credit risk assessment using AI and machine learning models to predict loan defaults. It streamlines the credit process with predictive analytics, model evaluation, explainability (SHAP), and deployment readiness.

automation banking-applications classification credit-risk explainability finance fintech flask fraud-detection lightgbm loan-prediction loan-prediction-analysis model-interpretability roc-auc shap sklearn vuejs xgboost

Last synced: 01 May 2026

https://github.com/perrin-isir/xomx

a python library providing data processing and machine learning tools for computational omics, with emphasis on explainability

bioinformatics computational-biology explainability machine-learning omics

Last synced: 18 Jan 2026

https://github.com/sbobek/knac

Knowledge Augmented Clustering

clustering explainability interpretability unsupervised xai

Last synced: 12 Jan 2026

https://github.com/deezer/functional_attribution

Code of our accepted ICML 2021 paper "Towards Rigorous Interpretations: a Formalisation of Feature Attribution" (D. Afchar, R. Hennequin, V. Guigue)

deezer explainability feature-selection interpretable-machine-learning xai

Last synced: 25 Oct 2025

https://github.com/sbobek/tsproto

Post-hoc prototype-based explanations with rules for time-series classifiers

deep-learning explainability interpretability machine-learning model-agnostic prototypes time-series

Last synced: 14 Dec 2025