Prototypical Self-Explainable Models Without Re-training
Explainable AI (XAI) has unfolded in two distinct research directions with, on the one hand, post-hoc methods that explain the predictions of a pre-trained black-box model and, on the other hand, self-explainable models (SEMs) which are trained directly to provide explanations alongside their predictions. While the latter is preferred in safety-critical scenarios, post-hoc approaches have received the majority of attention until now, owing to their simplicity and ability to explain base models without retraining. Current SEMs, instead, require complex architectures and heavily regularized loss functions, thus necessitating specific and costly training. To address this shortcoming and facilitate wider use of SEMs, we propose a simple yet efficient universal method called KMEx (K-Means Explainer), which can convert any existing pre-trained model into a prototypical SEM. The motivation behind KMEx is to enhance transparency in deep learning-based decision-making via class-prototype-based explanations that are diverse and trustworthy without retraining the base model. We compare models obtained from KMEx to state-of-the-art SEMs using an extensive qualitative evaluation to highlight the strengths and weaknesses of each model, further paving the way toward a more reliable and objective evaluation of SEMs (The code is available at https://github.com/SrishtiGautam/KMEx).
Code (1)
Tasks
Decision MakingExplainable ModelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pantypes: Diverse Representatives for Self-Explainable Models
Prototypical self-explainable classifiers have emerged to meet the growing demand for interpretable AI systems. These classifiers are designed to incorporate high transparency in their decisions by basing inference on si…
DiversityExplainable ModelsFairnessProtoS-ViT: Visual foundation models for sparse self-explainable classifications
Prototypical networks aim to build intrinsically explainable models based on the linear summation of concepts. Concepts are coherent entities that we, as humans, can recognize and associate with a certain object or entit…
Explainable ModelsEnclosing Prototypical Variational Autoencoder for Explainable Out-of-Distribution Detection
Understanding the decision-making and trusting the reliability of Deep Machine Learning Models is crucial for adopting such methods to safety-relevant applications. We extend self-explainable Prototypical Variational mod…
Decision MakingOut-of-Distribution DetectionOut of Distribution (OOD) DetectionProGReST: Prototypical Graph Regression Soft Trees for Molecular Property Prediction
In this work, we propose the novel Prototypical Graph Regression Self-explainable Trees (ProGReST) model, which combines prototype learning, soft decision trees, and Graph Neural Networks. In contrast to other works, our…
Graph RegressionMolecular Property PredictionPredictionProperty Prediction+1Tell me why: Visual foundation models as self-explainable classifiers
Visual foundation models (VFMs) have become increasingly popular due to their state-of-the-art performance. However, interpretability remains crucial for critical applications. In this sense, self-explainable models (SEM…
Explainable Models