Human-interpretable model explainability on high-dimensional data
The importance of explainability in machine learning continues to grow, as both neural-network architectures and the data they model become increasingly complex. Unique challenges arise when a model's input features become high dimensional: on one hand, principled model-agnostic approaches to explainability become too computationally expensive; on the other, more efficient explainability algorithms lack natural interpretations for general users. In this work, we introduce a framework for human-interpretable explainability on high-dimensional data, consisting of two modules. First, we apply a semantically meaningful latent representation, both to reduce the raw dimensionality of the data, and to ensure its human interpretability. These latent features can be learnt, e.g. explicitly as disentangled representations or implicitly through image-to-image translation, or they can be based on any computable quantities the user chooses. Second, we adapt the Shapley paradigm for model-agnostic explainability to operate on these latent features. This leads to interpretable model explanations that are both theoretically controlled and computationally tractable. We benchmark our approach on synthetic data and demonstrate its effectiveness on several image-classification tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationImage-to-Image TranslationmodelTranslationVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Genetic Programming for Explainable Manifold Learning
Manifold learning techniques play a pivotal role in machine learning by revealing lower-dimensional embeddings within high-dimensional data, thus enhancing both the efficiency and interpretability of data analysis by tra…
Explaining high-dimensional text classifiers
Explainability has become a valuable tool in the last few years, helping humans better understand AI-guided decisions. However, the classic explainability tools are sometimes quite limited when considering high-dimension…
Malware DetectionSentiment AnalysisExplainable and Interpretable Diabetic Retinopathy Classification Based on Neural-Symbolic Learning
In this paper, we propose an explainable and interpretable diabetic retinopathy (ExplainDR) classification model based on neural-symbolic learning. To gain explainability, a highlevel symbolic representation should be co…
ClassificationDecision MakingDisease PredictionAlgorithm-Agnostic Explainability for Unsupervised Clustering
Supervised machine learning explainability has developed rapidly in recent years. However, clustering explainability has lagged behind. Here, we demonstrate the first adaptation of model-agnostic explainability methods t…
BIG-bench Machine LearningClusteringExplainable artificial intelligenceFeature ImportanceHierarchical Vision Transformer with Prototypes for Interpretable Medical Image Classification
Explainability is a highly demanded requirement for applications in high-risk areas such as medicine. Vision Transformers have mainly been limited to attention extraction to provide insight into the model's reasoning. Ou…
image-classificationImage ClassificationLesion ClassificationMedical Image Classification+1