Projects in Awesome Lists tagged with explainability

https://github.com/shap/shap

A game theoretic approach to explain the output of any machine learning model.

deep-learning explainability gradient-boosting interpretability machine-learning shap shapley

Last synced: 11 Dec 2025

https://github.com/interpretml/interpret

Fit interpretable models. Explain blackbox machine learning.

ai artificial-intelligence bias blackbox differential-privacy explainability explainable-ai explainable-ml gradient-boosting iml interpretability interpretable-ai interpretable-machine-learning interpretable-ml interpretml machine-learning scikit-learn transparency xai

Last synced: 06 Feb 2026

https://github.com/maif/shapash

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

ethical-artificial-intelligence explainability explainable-ml interpretability lime machine-learning python shap transparency

Last synced: 30 Jan 2026

https://github.com/MAIF/shapash

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

ethical-artificial-intelligence explainability explainable-ml interpretability lime machine-learning python shap transparency

Last synced: 26 Mar 2025

https://github.com/hila-chefer/transformer-explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

attention-matrix attention-visualization bert bert-model cvpr2021 deep-learning explainability perturbation transformer-interpretability vision-transformer visualize-classifications vit

Last synced: 15 May 2025

https://github.com/hila-chefer/Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

attention-matrix attention-visualization bert bert-model cvpr2021 deep-learning explainability perturbation transformer-interpretability vision-transformer visualize-classifications vit

Last synced: 27 Mar 2025

https://github.com/microsoft/responsible-ai-toolbox

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

data-analysis data-science data-visualization error-analysis explainability explainable-ai explainable-ml fairness fairness-ai fairness-ml interpretability jupyter machine-learning machinelearning ml responsible-ai ui visualization widget widgets

Last synced: 13 May 2025

https://github.com/ethicalml/xai

XAI - An eXplainability toolbox for machine learning

ai artificial-intelligence bias bias-evaluation downsampling evaluation explainability explainable-ai explainable-ml feature-importance imbalance interpretability machine-learning machine-learning-explainability ml upsampling xai xai-library

Last synced: 15 May 2025

https://github.com/EthicalML/xai

XAI - An eXplainability toolbox for machine learning

ai artificial-intelligence bias bias-evaluation downsampling evaluation explainability explainable-ai explainable-ml feature-importance imbalance interpretability machine-learning machine-learning-explainability ml upsampling xai xai-library

Last synced: 14 Mar 2025

https://github.com/hila-chefer/transformer-mm-explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 12 Apr 2025

https://github.com/hila-chefer/Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 03 Apr 2025

https://github.com/h1st-ai/h1st

Power Tools for AI Engineers With Deadlines

automl autonomous-vehicles avionics cold-start collaboration cybersecurity data-science datascience-environment energy-optimization ensemble-machine-learning explainability hacktoberfest home-automation human-in-the-loop industrial-iot predictive-maintenance time-series trustworthy-datascience

Last synced: 14 Mar 2025

https://github.com/MisaOgura/flashtorch

Visualization toolkit for neural networks in PyTorch! Demo -->

cnn deep-learning explainability interpretability machine-learning neural-networks pytorch visualization

Last synced: 27 Mar 2025

https://github.com/alvinwan/neural-backed-decision-trees

Making decision trees competitive with neural networks on CIFAR10, CIFAR100, TinyImagenet200, Imagenet

cifar10 cifar100 decision-trees explainability image-classification imagenet interpretability neural-backed-decision-trees neural-networks pretrained-models pretrained-weights pytorch tiny-imagenet

Last synced: 27 Jun 2025

https://github.com/explainx/explainx

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code. We are looking for co-authors to take this project forward. Reach out @ ms8909@nyu.edu

aws-sagemaker bias blackbox explainability explainable-ai explainable-artificial-intelligence explainable-ml explainx interpretability interpretable-ai interpretable-machine-learning machine-learning machine-learning-interpretability scikit-learn transparency xai

Last synced: 16 May 2025

https://github.com/explainX/explainx

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code. We are looking for co-authors to take this project forward. Reach out @ ms8909@nyu.edu

aws-sagemaker bias blackbox explainability explainable-ai explainable-artificial-intelligence explainable-ml explainx interpretability interpretable-ai interpretable-machine-learning machine-learning machine-learning-interpretability scikit-learn transparency xai

Last synced: 04 Apr 2025

https://github.com/haofanwang/score-cam

Official implementation of Score-CAM in PyTorch

cam class-activation-maps cnn-visualization cnn-visualization-technique explainability grad-cam gradcam gradient-free heatmap pytorch saliency score-cam scorecam visual-explanations

Last synced: 06 Apr 2025

https://github.com/xmed-lab/CLIP_Surgery

CLIP Surgery for Better Explainability with Enhancement in Open-Vocabulary Tasks

clip explainability interpretability multilabel multimodal open-vocabulary sam segment-anything segmentation vision-transformer

Last synced: 16 Mar 2025

https://github.com/keisen/tf-keras-vis

Neural network visualization toolkit for tf.keras

activation-maximization deep-learning explainability explainable-ai explainable-ml grad-cam gradcam gradcam-plus-plus keras keras-vis keras-visualization python saliency saliency-maps score-cam tensorflow visualization xai xai-library

Last synced: 15 May 2025

https://github.com/hbaniecki/adversarial-explainable-ai

💡 Adversarial attacks on explanations and how to defend them

adversarial adversarial-attacks adversarial-examples adversarial-machine-learning attacks counterfactual deep defense evaluation explainability explainable-ai iml interpretability interpretable interpretable-machine-learning model responsible-ai robustness security xai

Last synced: 27 Jan 2026

https://github.com/carla-recourse/carla

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms

artificial-intelligence benchmark benchmarking counterfactual counterfactual-explanations counterfactuals explainability explainable-ai explainable-ml machine-learning python pytorch recourse tensorflow tensorflow2

Last synced: 05 Apr 2025

https://github.com/iancovert/sage

For calculating global feature importance using Shapley values.

explainability interpretability machine-learning shapley

Last synced: 26 Mar 2025

https://github.com/dmlc/gnnlens2

Visualization tool for Graph Neural Networks

deep-learning dgl explainability graph-neural-networks graph-representation-learning graph-visualization pytorch visualization xai

Last synced: 28 Oct 2025

https://github.com/AI4LIFE-GROUP/OpenXAI

OpenXAI : Towards a Transparent Evaluation of Model Explanations

benchmark explainability explainable-ai interpretability leaderboard reproducibility

Last synced: 28 Apr 2025

https://github.com/chr5tphr/zennit

Zennit is a high-level framework in Python using PyTorch for explaining/exploring neural networks using attribution methods like LRP.

attribution deep-learning explainability explainable-ai feature-attribution interpretability interpretable-ai interpretable-ml lrp machine-learning python pytorch xai

Last synced: 09 Apr 2025

https://github.com/charlesdedampierre/BunkaTopics

🗺️ Data Cleaning and Textual Data Visualization 🗺️

cartography data-cleaning explainability fine-tuning llms machine-learning natural-language-processing nlp summarization topic-modeling

Last synced: 30 Aug 2025

https://github.com/squaredev-io/whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

accuracy accuracy-metrics accuracy-score confusion-matrix explainability explainable-ai f1-score k8s kubernetes machine-learning ml-monitoring mlflow mlops model-monitoring modelops monitoring observability python recall xai

Last synced: 17 Jan 2026

https://github.com/feedzai/timeshap

TimeSHAP explains Recurrent Neural Network predictions.

explainability rnn shap shapley-values

Last synced: 05 Apr 2025

https://github.com/mims-harvard/graphxai

GraphXAI: Resource to support the development and evaluation of GNN explainers

benchmarking deep-learning embeddings explainability explainable-ai explainable-ml graph-machine-learning graph-neural-networks interpretability

Last synced: 10 Oct 2025

https://github.com/csinva/imodelsX

Interpret text data using LLMs (scikit-learn compatible).

ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai

Last synced: 05 May 2025

https://github.com/pietrobarbiero/pytorch_explain

PyTorch Explain: Interpretable Deep Learning in Python.

deep-learning entropy explainability explainable-ai interpretability interpretable-ai interpretable-deep-learning interpretable-machine-learning lens logic machine-learning neural-network python pytorch sympy

Last synced: 06 Apr 2025

https://github.com/astrazeneca/awesome-shapley-value

Reading list for "The Shapley Value in Machine Learning" (JCAI 2022)

artificial-intelligence data-science deep-learning explainability explainable explainable-ai explainable-artificial-intelligence explainable-ml lime machine-learning owen-value shap shapley shapley-additive-explanations shapley-decomposition shapley-q-value shapley-value xai

Last synced: 26 Dec 2025

https://github.com/hila-chefer/robustvit

[NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows to finetune the explainability maps of Vision Transformers to enhance robustness.

explainability neurips neurips-2022 robustness vision-transformer

Last synced: 13 Oct 2025

https://github.com/csinva/hierarchical-dnn-interpretations

Using / reproducing ACD from the paper "Hierarchical interpretations for neural network predictions" 🧠 (ICLR 2019)

acd ai artificial-intelligence convolutional-neural-networks data-science deep-learning deep-neural-networks explainability explainable-ai feature-importance iclr interpretability interpretation jupyter-notebook machine-learning ml neural-network python pytorch statistics

Last synced: 13 Jun 2025

https://github.com/laura-rieger/deep-explanation-penalization

Code for using CDEP from the paper "Interpretations are useful: penalizing explanations to align neural networks with prior knowledge" https://arxiv.org/abs/1909.13584

ai artificial-intelligence cdep convolutional-neural-network data-science deep-learning explainability explainable-ai fairness fairness-ml feature-importance interpretability interpretable-deep-learning jupyter-notebook machine-learning ml neural-network python pytorch recurrent-neural-network

Last synced: 08 May 2025

https://github.com/hila-chefer/RobustViT

[NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows to finetune the explainability maps of Vision Transformers to enhance robustness.

explainability neurips neurips-2022 robustness vision-transformer

Last synced: 08 May 2025

https://github.com/baldassarrefe/graph-network-explainability

Explainability techniques for Graph Networks, applied to a synthetic dataset and an organic chemistry task. Code for the workshop paper "Explainability Techniques for Graph Convolutional Networks" (ICML19)

artificial-intelligence bioinformatics explainability graph-networks

Last synced: 18 Mar 2025

https://github.com/d909b/cxplain

Causal Explanation (CXPlain) is a method for explaining the predictions of any machine-learning model.

deep-learning explainability explainable-ai explainable-ml interpretability machine-learning

Last synced: 17 Sep 2025

https://github.com/givasile/effector

Effector - a Python package for global and regional effect methods

explainability iml xai

Last synced: 30 Dec 2025

https://github.com/MolecularAI/QSARtuna

QSARtuna: QSAR model building with the optuna framework

chemprop compchem computational-chemistry explainability hyperparameter-optimization optuna peptide-modelling qsar qsar-models uncertainty-estimation

Last synced: 28 Sep 2025

https://github.com/M-Nauta/ProtoTree

ProtoTrees: Neural Prototype Trees for Interpretable Fine-grained Image Recognition, published at CVPR2021

computer-vision cvpr2021 decision-trees deep-neural-networks explainability explainable-ai explainable-ml fine-grained-classification fine-grained-visual-categorization interpretability interpretable-deep-learning interpretable-machine-learning pytorch

Last synced: 08 May 2025

https://github.com/snehankekre/streamlit-shap

streamlit-shap provides a wrapper to display SHAP plots in Streamlit.

explainability interpretability machine-learning shap shapley streamlit streamlit-component

Last synced: 21 Aug 2025

https://github.com/SAP-archive/contextual-ai

Contextual AI adds explainability to different stages of machine learning pipelines - data, training, and inference - thereby addressing the trust gap between such ML systems and their users. It does not refer to a specific algorithm or ML method — instead, it takes a human-centric view and approach to AI.

explainability machine-learning report-generator

Last synced: 18 Jul 2025

https://github.com/mertyg/post-hoc-cbm

Code for the paper "Post-hoc Concept Bottleneck Models". Spotlight @ ICLR 2023

concept-based-explanations concept-based-models concepts explainability interpretability

Last synced: 04 Sep 2025

https://github.com/csinva/imodelsx

Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.

ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai

Last synced: 16 May 2025

https://github.com/fat-forensics/fat-forensics

Modular Python Toolbox for Fairness, Accountability and Transparency Forensics

accountability explainability explainable-ai fairness interpretability interpretable-ai machine-learning transparency

Last synced: 27 Mar 2025

https://github.com/hila-chefer/conceptor

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 03 Jul 2025

https://hila-chefer.github.io/Conceptor/

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 27 Mar 2025

https://github.com/hila-chefer/Conceptor

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 27 Mar 2025

https://github.com/deel-ai/influenciae

👋 Influenciae is a Tensorflow Toolbox for Influence Functions

explainability explainable-ai fairness-ai influence-functions misclassification outlier-detection

Last synced: 16 May 2025

https://github.com/chirag-agarwall/VOG

Estimating Example Difficulty using Variance of Gradients

atypical-examples deep-learning explainability human-in-the-loop-auditing interpretability

Last synced: 08 May 2025

https://github.com/linkedin/te2rules

Python library to explain Tree Ensemble models (TE) like XGBoost, using a rule list.

explainability explainable-ai interpretability interpretable-ai machine-learning random-forest rule-learning tree-ensembles xgboost

Last synced: 11 Sep 2025

https://github.com/serre-lab/harmonization

👋 Aligning Human & Machine Vision using explainability

deep-learning explainability explainable-ai interpretability machine-learning neuroscience

Last synced: 08 Aug 2025

https://github.com/adaamko/potato

XAI based human-in-the-loop framework for automatic rule-learning.

classification explainability explainable-ai explainable-ml information-extraction interpretable-ai interpretable-machine-learning nlp nlp-machine-learning

Last synced: 27 Jul 2025

https://github.com/serre-lab/lens

LENS Project

deep-learning explainability xai

Last synced: 29 Jan 2026

https://github.com/tjiagoM/spatio-temporal-brain

A Deep Graph Neural Network Architecture for Modelling Spatio-temporal Dynamics in rs-fMRI Data

explainability fmri gnn temporal-convolutional-network wandb-agent

Last synced: 01 May 2025

https://github.com/csinva/iprompt

Finding semantically meaningful and accurate prompts.

ai autoprompt deep-learning explainability explainable-ai interpretability iprompt language-model large-language-models ml natural-language-processing neural-network prompting text text-classification xai

Last synced: 30 Apr 2025

https://github.com/trustyai-explainability/trustyai-explainability

TrustyAI Explainability Toolkit

explainability explainableai hacktoberfest interpretability java python xai xai-library

Last synced: 13 Jul 2025

https://github.com/florianwilhelm/lda4rec

🧮 Extended Latent Dirichlet Allocation for Collaborative Filtering in Recommender Systems.

collaborative-filtering explainability interpretability python recommender-system

Last synced: 15 Sep 2025

https://github.com/csinva/interpretable-embeddings

Interpretable text embeddings by asking LLMs yes/no questions (NeurIPS 2024)

ai artificial-intelligence embeddings encoding-models explainability fmri huggingface language-model llm neural-network neuroscience rag retrieval-augmented-generation transformer xai

Last synced: 07 May 2025

https://github.com/microsoft/augmented-interpretable-models

Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.

ai artificial-intelligence deep-learning distillation embedding explainability huggingface interpretability language-model large-language-models linear linear-models logistic-regression machine-learning ml neural-network scikit-learn sentiment-classification transformer transparent

Last synced: 19 Oct 2025

https://github.com/yc015/scene-representation-diffusion-model

Linear probe found representations of scene attributes in a text-to-image diffusion model

explainability image-editing interpretability scene stable-diffusion

Last synced: 20 Jan 2026

https://github.com/zbr17/AVSL

[CVPR 2022] Official PyTorch implementation for Attributable Visual Similarity Learning

explainability metric-learning similarity-learning

Last synced: 08 May 2025

https://github.com/pyartemis/artemis

A Python package with explanation methods for extraction of feature interactions from predictive models

data-science explainability explainable-ai explainable-ml explanatory-model-analysis iml interpretability interpretable-machine-learning machine-learning predictive-modeling xai xai-library

Last synced: 13 Dec 2025

https://github.com/microsoft/responsible-ai-workshop

Responsible AI Workshop: a series of tutorials & walkthroughs to illustrate how put responsible AI into practice

error-analysis explainability explainable-ai explainable-ml fairness fairness-ai fairness-ml jupyter-notebook machine-learning ml mlops-workshop principles responsible-ai widgets

Last synced: 19 Oct 2025

https://github.com/koriavinash1/bioexp

Explainability of Deep Learning Models

ablation activation-maximization causal-inference causality clustering concept-extraction dissection explainability explainable-ai gradcam interpretability interpretable-ai intervention joint-analysis rct uncertainty

Last synced: 01 May 2025

https://github.com/oracle-samples/automlx

This repository contains demo notebooks (sample code) for the AutoMLx (automated machine learning and explainability) package from Oracle Labs.

ai automated-machine-learning automl automlx classification data-science explainability fairness fairness-ai hyperparameter-optimization interpretability machine-learning machine-learning-explainability mlx oracle python regression timeseries-forecasting tuning unsupervised-anomaly-detection

Last synced: 01 Jul 2025

https://github.com/cloudera/cml_amp_explainability_lime_shap

Learn how to explain ML models using LIME and SHAP.

explainability interpretability lime shap

Last synced: 13 Apr 2025

https://github.com/ottenbreit-data-science/aplr

APLR builds predictive, interpretable regression and classification models using Automatic Piecewise Linear Regression. It often rivals tree-based methods in predictive accuracy while offering smoother and interpretable predictions.

ai artificial-intelligence classification explainability explainable-ai explainable-ml general-additive-model generalized-linear-models glm gradient-boosting interpretability interpretable-ai interpretable-machine-learning interpretable-ml linear-regression machine-learning piecewise-linear-regression regression scikit-learn transparency

Last synced: 19 Aug 2025

https://github.com/lexsi-labs/dlbacktrace

DL Backtrace is a new explainablity technique for deep learning models that works for any modality and model type.

deep-learning explainability xai

Last synced: 23 Jan 2026

https://github.com/AgaMiko/GEBI

GEBI: Global Explanations for Bias Identification. Open source code for discovering bias in data with skin lesion dataset

attention-maps deep-learning explainability explainable-ai global-explanation

Last synced: 19 Apr 2025

https://github.com/agamiko/gebi

GEBI: Global Explanations for Bias Identification. Open source code for discovering bias in data with skin lesion dataset

attention-maps deep-learning explainability explainable-ai global-explanation

Last synced: 14 Apr 2025

https://github.com/cloudera/cml_amp_churn_prediction

Build an scikit-learn model to predict churn using customer telco data.

churn-prediction explainability interpretability lime logistic-regression

Last synced: 13 Apr 2025

https://github.com/capitalone/ablation

Evaluating XAI methods through ablation studies.

ablation explainability ground-truth xai

Last synced: 01 Sep 2025

https://github.com/jgalego/awesome-safety-critical-ai

A curated list of references on the role of AI in safety-critical systems ⚠️

ai-privacy ai-safety artificial-intelligence awesome awesome-list awesome-lists compliance explainability genai machine-learning red-team reliability responsible-ai safety-critical trustworthy-ai

Last synced: 01 Mar 2025

https://github.com/sbobek/lux

Local Universal Rule-based Explanations

counterfactual-explanations explainability explainable-artificial-intelligence interpretability local-explanations model-agnostic-explanations rule-based-explanations

Last synced: 12 Jan 2026

https://github.com/kohlerhector/interpreter-py

Implementation of Interpretable and Editable Programmatic Tree Policies for Reinforcement Learning (Kohler, Delfosse, et. al. 2024).

code-generation explainability explainable-ai imitation-learning interpretability mujoco program-generation programmatic reinforcement-learning

Last synced: 14 Apr 2025

https://github.com/prclibo/ice

Interpretable Control Exploration and Counterfactual Explanation (ICE) on StyleGAN

counterfactual-explanations explainability explainable-ai explainable-artificial-intelligence explainable-machine-learning explainable-ml face-editing face-generation face-manipulation gan interpretability interpretable-ai interpretable-deep-learning pytorch stylegan2

Last synced: 19 Jan 2026

https://github.com/alshedivat/cen

Contextual Explanation Networks (CEN).

deep-learning explainability interpretability keras machine-learning tensorflow

Last synced: 07 May 2025

https://github.com/chinefed/convolutional-set-transformer

Official implementation of the Convolutional Set Transformer (Chinello & Boracchi, 2025). This repository includes the source code of the cstmodels Python package, which provides reusable Keras 3 layers for constructing CST architectures, together with an interface to load and use the CST-15 model pre-trained on ImageNet.

anomaly-detection computer-vision convolutional-set-transformer deep-learning explainability image-classification set-learning transfer-learning

Last synced: 14 Jan 2026

https://github.com/andreabac3/study-transfer-learning-covid-19

This repository contains the official code of the research paper Study on transfer learning capabilities for pneumonia classification in chest-x-rays images pubblished at the Computer Methods and Programs in Biomedicine Journal.

computer-vision covid cv explainability explainable-ai pytorch pytorch-lightning torch

Last synced: 09 Nov 2025

https://github.com/warisgill/tracefl

TraceFL is a novel mechanism for Federated Learning that achieves interpretability by tracking neuron provenance. It identifies clients responsible for global model predictions, achieving 99% accuracy across diverse datasets (e.g., medical imaging) and neural networks (e.g., GPT).

accountability debugging differential-privacy explainability explainable-ai federated-learning interpretability interpretability-and-explainability machine-learning software-engineering testing