Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypes
We present a deformable prototypical part network (Deformable ProtoPNet), an interpretable image classifier that integrates the power of deep learning and the interpretability of case-based reasoning. This model classifies input images by comparing them with prototypes learned during training, yielding explanations in the form of "this looks like that." However, while previous methods use spatially rigid prototypes, we address this shortcoming by proposing spatially flexible prototypes. Each prototype is made up of several prototypical parts that adaptively change their relative spatial positions depending on the input image. Consequently, a Deformable ProtoPNet can explicitly capture pose variations and context, improving both model accuracy and the richness of explanations provided. Compared to other case-based interpretable models using prototypes, our approach achieves state-of-the-art accuracy and gives an explanation with greater context. The code is available at https://github.com/jdonnelly36/Deformable-ProtoPNet.
Code (1)
Tasks
FairnessImage ClassificationSimilar Papers 제목 키워드 기반
Improving Prototypical Visual Explanations with Reward Reweighing, Reselection, and Retraining
In recent years, work has gone into developing deep interpretable methods for image classification that clearly attributes a model's output to specific features of the data. One such of these methods is the Prototypical …
image-classificationImage ClassificationRapid Deformable Object Detection using Dual-Tree Branch-and-Bound
In this work we use Branch-and-Bound (BB) to efficiently detect objects with deformable part models. Instead of evaluating the classifier score exhaustively over image locations and scales, we use BB to focus on promisi…
object-detectionObject DetectionKnowledge Distillation to Ensemble Global and Interpretable Prototype-Based Mammogram Classification Models
State-of-the-art (SOTA) deep learning mammogram classifiers, trained with weakly-labelled images, often rely on global models that produce predictions with limited interpretability, which is a key barrier to their succes…
DiversityKnowledge DistillationThis Looks Like That: Deep Learning for Interpretable Image Recognition
When we are faced with challenging image classification tasks, we often explain our reasoning by dissecting the image, and pointing out prototypical aspects of one class or another. The mounting evidence for each of the …
Deep LearningGeneral Classificationimage-classificationImage ClassificationSwin Deformable Attention Hybrid U-Net for Medical Image Segmentation
Medical image segmentation is a crucial task in the field of medical image analysis. Harmonizing the convolution and multi-head self-attention mechanism is a recent research focus in this field, with various combination …
Image SegmentationLesion SegmentationMedical Image AnalysisMedical Image Segmentation+2