One Explanation is Not Enough: Structured Attention Graphs for Image Classification
Attention maps are a popular way of explaining the decisions of convolutional networks for image classification. Typically, for each image of interest, a single attention map is produced, which assigns weights to pixels based on their importance to the classification. A single attention map, however, provides an incomplete understanding since there are often many other maps that explain a classification equally well. In this paper, we introduce structured attention graphs (SAGs), which compactly represent sets of attention maps for an image by capturing how different combinations of image regions impact a classifier's confidence. We propose an approach to compute SAGs and a visualization for SAGs so that deeper insight can be gained into a classifier's decisions. We conduct a user study comparing the use of SAGs to traditional attention maps for answering counterfactual questions about image classifications. Our results show that the users are more correct when answering comparative counterfactual questions based on SAGs compared to the baselines.
Code (1)
Tasks
ClassificationcounterfactualGeneral Classificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Explanation Graph Generation via Generative Pre-training over Synthetic Graphs
The generation of explanation graphs is a significant task that aims to produce explanation graphs in response to user input, revealing the internal reasoning process. This task is challenging due to the significant disc…
Graph GenerationLanguage ModellingGenerating Natural Language Explanations for Visual Question Answering using Scene Graphs and Visual Attention
In this paper, we present a novel approach for the task of eXplainable Question Answering (XQA), i.e., generating natural language (NL) explanations for the Visual Question Answering (VQA) problem. We generate NL explana…
Explanation GenerationLanguage ModelingLanguage ModellingQuestion Answering+2Reliability, Faithfulness, and the Limits of Post-hoc Explanations of Opaque Scientific Models
Post-hoc explanation methods are routinely used to interpret scientific machine learning models, with the deliverable understood to be insight into the phenomenon the model has been trained on. The transition may be take…
ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning
Recent commonsense-reasoning tasks are typically discriminative in nature, where a model answers a multiple-choice question for a certain context. Discriminative tasks are limiting because they fail to adequately evaluat…
Graph GenerationMultiple-choiceText GenerationAttentional Multilabel Learning over Graphs: A Message Passing Approach
We address a largely open problem of multilabel classification over graphs. Unlike traditional vector input, a graph has rich variable-size substructures which are related to the labels in some ways. We believe that unco…
General ClassificationGraph Neural NetworkMulti-Label Learning