paper-with-me

홈 › Papers

Less is More: Discovering Concise Network Explanations

2024-05-24 · Neehar Kondapaneni, Markus Marks, Oisin Mac Aodha, Pietro Perona

We introduce Discovering Conceptual Network Explanations (DCNE), a new approach for generating human-comprehensible visual explanations to enhance the interpretability of deep neural image classifiers. Our method automatically finds visual explanations that are critical for discriminating between classes. This is achieved by simultaneously optimizing three criteria: the explanations should be few, diverse, and human-interpretable. Our approach builds on the recently introduced Concept Relevance Propagation (CRP) explainability method. While CRP is effective at describing individual neuronal activations, it generates too many concepts, which impacts human comprehension. Instead, DCNE selects the few most important explanations. We introduce a new evaluation dataset centered on the challenging task of classifying birds, enabling us to compare the alignment of DCNE's explanations to those of human expert-defined ones. Compared to existing eXplainable Artificial Intelligence (XAI) methods, DCNE has a desirable trade-off between conciseness and completeness when summarizing network explanations. It produces 1/30 of CRP's explanations while only resulting in a slight reduction in explanation quality. DCNE represents a step forward in making neural network decisions accessible and interpretable to humans, providing a valuable tool for both researchers and practitioners in XAI and model alignment.

📄 PDF Abstract BibTeX arXiv:2405.15243

Code (1)

nkondapa/discoveringconcisenetworkexplanations 공식 구현 pytorch

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Similar Papers 제목 키워드 기반

PRINCE: Provider-side Interpretability with Counterfactual Explanations in Recommender Systems

2019-11-19 · Azin Ghazimatin, Oana Balalau, Rishiraj Saha Roy, Gerhard Weikum

Interpretable explanations for recommender systems and other machine learning models are crucial to gain user trust. Prior works that have focused on paths connecting users and items in a heterogeneous network have sever…

counterfactualRecommendation Systems

Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension

2021-09-14 · EMNLP 2021 11 · Naoya Inoue, Harsh Trivedi, Steven Sinha, Niranjan Balasubramanian 외

How can we generate concise explanations for multi-hop Reading Comprehension (RC)? The current strategies of identifying supporting sentences can be seen as an extractive question-focused summarization of the input text.…

2kMulti-Hop Reading ComprehensionReading Comprehension

PAGE: Prototype-Based Model-Level Explanations for Graph Neural Networks

2022-10-31 · Yong-Min Shin, Sun-Woo Kim, Won-Yong Shin

Aside from graph neural networks (GNNs) attracting significant attention as a powerful framework revolutionizing graph representation learning, there has been an increasing demand for explaining GNN models. Although vari…

Computational EfficiencyGraph ClassificationGraph Representation LearningRepresentation Learning

The Sufficiency-Conciseness Trade-off in LLM Self-Explanation from an Information Bottleneck Perspective

2026-02-15 · Ali Zahedzadeh, Behnam Bahrak arxiv

Large Language Models increasingly rely on self-explanations, such as chain of thought reasoning, to improve performance on multi step question answering. While these explanations enhance accuracy, they are often verbose…

Question Answering

Efficient and Concise Explanations for Object Detection with Gaussian-Class Activation Mapping Explainer

2024-04-20 · Quoc Khanh Nguyen, Truong Thanh Hung Nguyen, Vo Thanh Khang Nguyen, Van Binh Truong 외

To address the challenges of providing quick and plausible explanations in Explainable AI (XAI) for object detection models, we introduce the Gaussian Class Activation Mapping Explainer (G-CAME). Our method efficiently g…

Objectobject-detectionObject Detection