Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with explainable-ai

A curated list of projects in awesome lists tagged with explainable-ai .

https://github.com/jacobgil/pytorch-grad-cam

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

class-activation-maps computer-vision deep-learning explainable-ai explainable-ml grad-cam image-classification interpretability interpretable-ai interpretable-deep-learning machine-learning object-detection pytorch score-cam vision-transformers visualizations xai

Last synced: 12 May 2025

https://github.com/microsoft/responsible-ai-toolbox

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.

data-analysis data-science data-visualization error-analysis explainability explainable-ai explainable-ml fairness fairness-ai fairness-ml interpretability jupyter machine-learning machinelearning ml responsible-ai ui visualization widget widgets

Last synced: 13 May 2025

https://github.com/interpretml/dice

Generate Diverse Counterfactual Explanations for any machine learning model.

counterfactual-explanations deep-learning explainable-ai explainable-ml interpretable-machine-learning machine-learning xai

Last synced: 13 May 2025

https://github.com/interpretml/DiCE

Generate Diverse Counterfactual Explanations for any machine learning model.

counterfactual-explanations deep-learning explainable-ai explainable-ml interpretable-machine-learning machine-learning xai

Last synced: 25 Mar 2025

https://github.com/cdpierse/transformers-interpret

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

captum computer-vision deep-learning explainable-ai interpretability machine-learning model-explainability natural-language-processing neural-network nlp transformers transformers-model

Last synced: 15 May 2025

https://github.com/dmitryryumin/iccv-2023-papers

ICCV 2023 Papers: Discover cutting-edge research from ICCV 2023, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. ⭐ support visual intelligence development!

3d-graphics 3d-reconstruction biometrics computer-vision datasets deep-learning explainable-ai face-recognition gesture-recognition iccv iccv2023 image-processing image-synthesis multimodal-learning pattern-recognition photogrammetry pose-estimation robotics transfer-learning video-synthesis

Last synced: 16 May 2025

https://github.com/jacobgil/vit-explain

Explainability for Vision Transformers

deep-learning explainable-ai pytorch transformer vision-transformer

Last synced: 04 Apr 2025

https://github.com/hila-chefer/transformer-mm-explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 12 Apr 2025

https://github.com/hila-chefer/Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

clip detr explainability explainable-ai interpretability lxmert transformer transformers visualbert visualization vqa

Last synced: 03 Apr 2025

https://github.com/castorini/daam

Diffusion attentive attribution maps for interpreting Stable Diffusion.

diffusion explainable-ai generative-ai huggingface pytorch stable-diffusion

Last synced: 16 May 2025

https://github.com/deel-ai/xplique

👋 Xplique is a Neural Networks Explainability Toolbox

explainable-ai explainable-ml interpretability xai

Last synced: 16 May 2025

https://github.com/understandable-machine-intelligence-lab/quantus

Quantus is an eXplainable AI toolkit for responsible evaluation of neural network explanations

deep-learning explainable-ai interpretability machine-learning pytorch quantification-evaluation-methods reproducibility tensorflow xai

Last synced: 14 May 2025

https://github.com/linkedin/fasttreeshap

Fast SHAP value computation for interpreting tree-based models

explainable-ai interpretability lightgbm machine-learning random-forest shap xgboost

Last synced: 17 Aug 2025

https://github.com/linkedin/FastTreeSHAP

Fast SHAP value computation for interpreting tree-based models

explainable-ai interpretability lightgbm machine-learning random-forest shap xgboost

Last synced: 19 Jul 2025

https://github.com/understandable-machine-intelligence-lab/Quantus

Quantus is an eXplainable AI toolkit for responsible evaluation of neural network explanations

deep-learning explainable-ai interpretability machine-learning pytorch quantification-evaluation-methods reproducibility tensorflow xai

Last synced: 08 May 2025

https://github.com/explainx/explainx

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code. We are looking for co-authors to take this project forward. Reach out @ ms8909@nyu.edu

aws-sagemaker bias blackbox explainability explainable-ai explainable-artificial-intelligence explainable-ml explainx interpretability interpretable-ai interpretable-machine-learning machine-learning machine-learning-interpretability scikit-learn transparency xai

Last synced: 16 May 2025

https://github.com/explainX/explainx

Explainable AI framework for data scientists. Explain & debug any blackbox machine learning model with a single line of code. We are looking for co-authors to take this project forward. Reach out @ ms8909@nyu.edu

aws-sagemaker bias blackbox explainability explainable-ai explainable-artificial-intelligence explainable-ml explainx interpretability interpretable-ai interpretable-machine-learning machine-learning machine-learning-interpretability scikit-learn transparency xai

Last synced: 04 Apr 2025

https://github.com/joaolages/diffusers-interpret

Diffusers-Interpret 🤗🧨🕵️‍♀️: Model explainability for 🤗 Diffusers. Get explanations for your generated images.

computer-vision deep-learning diffusers diffusion explainable-ai image-generation interpretability model-explainability primary-attributions pytorch text2image transformers

Last synced: 05 Apr 2025

https://github.com/AI4LIFE-GROUP/OpenXAI

OpenXAI : Towards a Transparent Evaluation of Model Explanations

benchmark explainability explainable-ai interpretability leaderboard reproducibility

Last synced: 28 Apr 2025

https://github.com/chr5tphr/zennit

Zennit is a high-level framework in Python using PyTorch for explaining/exploring neural networks using attribution methods like LRP.

attribution deep-learning explainability explainable-ai feature-attribution interpretability interpretable-ai interpretable-ml lrp machine-learning python pytorch xai

Last synced: 09 Apr 2025

https://github.com/suinleelab/path_explain

A repository for explaining feature attributions and feature interactions in deep neural networks.

explainable-ai interpretable-deep-learning machine-learning pytorch tensorflow

Last synced: 26 Dec 2025

https://github.com/squaredev-io/whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

accuracy accuracy-metrics accuracy-score confusion-matrix explainability explainable-ai f1-score k8s kubernetes machine-learning ml-monitoring mlflow mlops model-monitoring modelops monitoring observability python recall xai

Last synced: 17 Jan 2026

https://github.com/archd3sai/Customer-Survival-Analysis-and-Churn-Prediction

In this project, I have utilized survival analysis models to see how the likelihood of the customer churn changes over time and to calculate customer LTV. I have also implemented the Random Forest model to predict if a customer is going to churn and deployed a model using the flask web app.

customer-churn-prediction customer-survival-analysis data-analysis explainable-ai flask-application hazard partial-dependence-plot random-forest shap-values survival-analysis

Last synced: 08 Apr 2025

https://github.com/idealo/cnn-exposed

🕵️‍♂️ Interpreting Convolutional Neural Network (CNN) Results.

computer-vision deep-learning explainable-ai interpretable-machine-learning machine-learning neural-network

Last synced: 01 May 2025

https://github.com/eclique/RISE

Detect model's attention

classification explainable-ai saliency saliency-map xai

Last synced: 08 May 2025

https://github.com/hkuds/xrec

[EMNLP'2024] "XRec: Large Language Models for Explainable Recommendation"

explainable-ai large-language-models recommender-systems

Last synced: 18 Jul 2025

https://github.com/ictnlp/truthx

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

baichuan chatglm chatgpt explainable-ai gpt-4 hallucination hallucinations language-model llama llama2 llama3 llm llm-inference llms mistral representation safety truthfulness

Last synced: 03 Aug 2025

https://github.com/norskregnesentral/shapr

Explaining the output of machine learning models with more accurately estimated Shapley values

explainable-ai explainable-ml rcpp rcpparmadillo rstats shapley

Last synced: 21 Jan 2026

https://github.com/NorskRegnesentral/shapr

Explaining the output of machine learning models with more accurately estimated Shapley values

explainable-ai explainable-ml rcpp rcpparmadillo rstats shapley

Last synced: 13 Jul 2025

https://github.com/JuliaTrustworthyAI/CounterfactualExplanations.jl

A package for Counterfactual Explanations and Algorithmic Recourse in Julia.

counterfactual-explanations deep-learning explainable-ai julia machine-learning

Last synced: 28 Apr 2025

https://github.com/juliatrustworthyai/counterfactualexplanations.jl

A package for Counterfactual Explanations and Algorithmic Recourse in Julia.

counterfactual-explanations deep-learning explainable-ai julia machine-learning

Last synced: 05 Apr 2025

https://github.com/d909b/cxplain

Causal Explanation (CXPlain) is a method for explaining the predictions of any machine-learning model.

deep-learning explainability explainable-ai explainable-ml interpretability machine-learning

Last synced: 17 Sep 2025

https://github.com/fitushar/3d-guidedgradcam-for-medical-imaging

This Repo containes the implemnetation of generating Guided-GradCAM for 3D medical Imaging using Nifti file in tensorflow 2.0. Different input files can be used in that case need to edit the input to the Guided-gradCAM model.

3d-guided-grad-cam 3d-models cnn-visualization cnn-visualization-technique ctci explainable-ai explainable-ai-in-medical-imaging explainable-artificial-intelligence guided-grad-cam medical-imaging nifti tensorflow-examples tensorflow2

Last synced: 02 May 2025

https://github.com/fdalvi/neurox

A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.

explainable-ai natural-language-processing neurons nlp nlp-machine-learning

Last synced: 12 May 2025

https://github.com/HKUDS/XRec

[EMNLP'2024] "XRec: Large Language Models for Explainable Recommendation"

explainable-ai large-language-models recommender-systems

Last synced: 03 Apr 2025

https://github.com/shijx12/XNM-Net

Pytorch implementation of "Explainable and Explicit Visual Reasoning over Scene Graphs "

clevr cvpr2019 explainable-ai neural-module-networks scene-graph visual-reasoning

Last synced: 02 Apr 2025

https://github.com/fdalvi/NeuroX

A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.

explainable-ai natural-language-processing neurons nlp nlp-machine-learning

Last synced: 11 May 2025

https://github.com/umcutrecht-ecgxai/ecgxai

Neatly packaged AI methods for explainable ECG analysis

deep-learning deep-neural-networks ecg explainable-ai variational-autoencoder

Last synced: 10 Mar 2026

https://github.com/fat-forensics/fat-forensics

Modular Python Toolbox for Fairness, Accountability and Transparency Forensics

accountability explainability explainable-ai fairness interpretability interpretable-ai machine-learning transparency

Last synced: 27 Mar 2025

https://github.com/hila-chefer/conceptor

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 03 Jul 2025

https://github.com/hila-chefer/Conceptor

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 27 Mar 2025

https://hila-chefer.github.io/Conceptor/

Official implementation of the paper The Hidden Language of Diffusion Models

explainability explainable-ai generative-model stable-diffusion

Last synced: 27 Mar 2025

https://github.com/firmai/ml-fairness-framework

FairPut - Machine Learning Fairness Framework with LightGBM — Explainability, Robustness, Fairness (by @firmai)

aif360 aix360 alibi contrastive counterfactual explainable-ai explainable-ml fairness-ai fairness-indicators fairness-ml interpretable-machine-learning prototypical xai

Last synced: 06 May 2025

https://github.com/lunayach/visner

In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.

angular4 contextual-embeddings deployment entity-extraction explainable-ai flair flair-embeddings flask ner nlp nlp-machine-learning python visualization

Last synced: 26 Oct 2025

https://github.com/alexduvalinho/graphsvx

Explanation method for Graph Neural Networks (GNNs)

explainable-ai explainer gnn graphs

Last synced: 02 Apr 2026