paper-with-me

Papers

Leveraging Latent Features for Local Explanations

2019-05-29 · Ronny Luss, Pin-Yu Chen, Amit Dhurandhar, Prasanna Sattigeri, Yunfeng Zhang, Karthikeyan Shanmugam, Chun-Chen Tu

As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot research topic, both at the global and local level. Locally, most explanation methods have focused on identifying relevance of features, limiting the types of explanations possible. In this paper, we investigate a new direction by leveraging latent features to generate contrastive explanations; predictions are explained not only by highlighting aspects that are in themselves sufficient to justify the classification, but also by new aspects which if added will change the classification. The key contribution of this paper lies in how we add features to rich data in a formal yet humanly interpretable way that leads to meaningful results. Our new definition of "addition" uses latent features to move beyond the limitations of previous explanations and resolve an open question laid out in Dhurandhar, et. al. (2018), which creates local contrastive explanations but is limited to simple datasets such as grayscale images. The strength of our approach in creating intuitive explanations that are also quantitatively superior to other methods is demonstrated on three diverse image datasets (skin lesions, faces, and fashion apparel). A user study with 200 participants further exemplifies the benefits of contrastive information, which can be viewed as complementary to other state-of-the-art interpretability methods.

📄 PDF Abstract BibTeX arXiv:1905.12698

Code (2)

Trusted-AI/AIX360 공식 구현 pytorch
dwiggles/AIX360-withdata tf

Tasks

General ClassificationOpen-Ended Question AnsweringSelf-Driving Cars

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

WASUP: Interpretable Classification with Weight-Input Alignment and Class-Discriminative SUPports Vectors

2025-01-28 · Tom Nuno Wolf, Christian Wachinger

The deployment of deep learning models in critical domains necessitates a balance between high accuracy and interpretability. We introduce WASUP, an inherently interpretable neural network that provides local and global …

Decision MakingMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

GLANCE: Global to Local Architecture-Neutral Concept-based Explanations

2022-07-05 · Avinash Kori, Ben Glocker, Francesca Toni

Most of the current explainability techniques focus on capturing the importance of features in input space. However, given the complexity of models and data-generating processes, the resulting explanations are far from b…

DisentanglementFeature ImportanceKnowledge Distillation

Leveraging Manifold Embeddings for Enhanced Graph Transformer Representations and Learning

2025-07-09 · Ankit Jyothish, Ali Jannesari arxiv

Graph transformers typically embed every node in a single Euclidean space, blurring heterogeneous topologies. We prepend a lightweight Riemannian mixture-of-experts layer that routes each node to various kinds of manifol…

LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multimodal Large Language Models

2024-06-21 · Mengdan Zhu, Raasikh Kanjiani, Jiahui Lu, Andrew Choi 외

Deep generative models like VAEs and diffusion models have advanced various generation tasks by leveraging latent variables to learn data distributions and generate high-quality samples. Despite the field of explainable …

Uncertainty Quantification

Context-dependent Explainability and Contestability for Trustworthy Medical Artificial Intelligence: Misclassification Identification of Morbidity Recognition Models in Preterm Infants

2022-12-17 · Isil Guzey, Ozlem Ucar, Nukhet Aladag Ciftdemir, Betul Acunas

Although machine learning (ML) models of AI achieve high performances in medicine, they are not free of errors. Empowering clinicians to identify incorrect model recommendations is crucial for engendering trust in medica…

Explainable Artificial Intelligence (XAI)