SCOUTER: Slot Attention-based Classifier for Explainable Image Recognition
Explainable artificial intelligence has been gaining attention in the past few years. However, most existing methods are based on gradients or intermediate features, which are not directly involved in the decision-making process of the classifier. In this paper, we propose a slot attention-based classifier called SCOUTER for transparent yet accurate classification. Two major differences from other attention-based methods include: (a) SCOUTER's explanation is involved in the final confidence for each category, offering more intuitive interpretation, and (b) all the categories have their corresponding positive or negative explanation, which tells "why the image is of a certain category" or "why the image is not of a certain category." We design a new loss tailored for SCOUTER that controls the model's behavior to switch between positive and negative explanations, as well as the size of explanatory regions. Experimental results show that SCOUTER can give better visual explanations in terms of various metrics while keeping good accuracy on small and medium-sized datasets.
Code (1)
Tasks
Decision MakingExplainable artificial intelligenceSimilar Papers 제목 키워드 기반
Explainable Image Recognition via Enhanced Slot-attention Based Classifier
The imperative to comprehend the behaviors of deep learning models is of utmost importance. In this realm, Explainable Artificial Intelligence (XAI) has emerged as a promising avenue, garnering increasing interest in rec…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling
Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and im…
Intent DetectionNatural Language Understandingslot-fillingSlot FillingLearning Object-Centric Representations in SAR Images with Multi-Level Feature Fusion
Synthetic aperture radar (SAR) images contain not only targets of interest but also complex background clutter, including terrain reflections and speckle noise. In many cases, such clutter exhibits intensity and patterns…
Object-Centric Case-Based Reasoning via Argumentation
We introduce Slot Attention Argumentation for Case-Based Reasoning (SAA-CBR), a novel neuro-symbolic pipeline for image classification that integrates object-centric learning via a neural Slot Attention (SA) component wi…
Multi-class ClassificationImage ClassificationAutomatic Vision-Based Parking Slot Detection and Occupancy Classification
Parking guidance information (PGI) systems are used to provide information to drivers about the nearest parking lots and the number of vacant parking slots. Recently, vision-based solutions started to appear as a cost-ef…