paper-with-me

Papers

Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI

2025-04-16 · Mahdi Alehdaghi, Rajarshi Bhattacharya, Pourya Shamsolmoali, Rafael M. O. Cruz, Maguelonne Heritier, Eric Granger

Deep learning has provided considerable advancements for multimedia systems, yet the interpretability of deep models remains a challenge. State-of-the-art post-hoc explainability methods, such as GradCAM, provide visual interpretation based on heatmaps but lack conceptual clarity. Prototype-based approaches, like ProtoPNet and PIPNet, offer a more structured explanation but rely on fixed patches, limiting their robustness and semantic consistency. To address these limitations, a part-prototypical concept mining network (PCMNet) is proposed that dynamically learns interpretable prototypes from meaningful regions. PCMNet clusters prototypes into concept groups, creating semantically grounded explanations without requiring additional annotations. Through a joint process of unsupervised part discovery and concept activation vector extraction, PCMNet effectively captures discriminative concepts and makes interpretable classification decisions. Our extensive experiments comparing PCMNet against state-of-the-art methods on multiple datasets show that it can provide a high level of interpretability, stability, and robustness under clean and occluded scenarios.

📄 PDF Abstract BibTeX arXiv:2504.12197

Code (0)

등록된 구현이 없습니다.

Tasks

Unsupervised Part Discovery

Similar Papers 제목 키워드 기반

PIP-Net: Patch-Based Intuitive Prototypes for Interpretable Image Classification

2023-01-01 · CVPR 2023 1 · Meike Nauta, Jörg Schlötterer, Maurice van Keulen, Christin Seifert

Interpretable methods based on prototypical patches recognize various components in an image in order to explain their reasoning to humans. However, existing prototype-based methods can learn prototypes that are not …

Decision Makingimage-classificationImage Classification

PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis

2025-06-12 · Marzieh Oghbaie, Teresa Araújoa, Hrvoje Bogunović

Background and Objective: Prototype-based methods improve interpretability by learning fine-grained part-prototypes; however, their visualization in the input pixel space is not always consistent with human-understandabl…

Contrastive LearningDiagnosticimage-classificationImage Classification

Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentation

2024-09-14 · Hugo Porta, Emanuele Dalsasso, Diego Marcos, Devis Tuia

Prototypical part learning is emerging as a promising approach for making semantic segmentation interpretable. The model selects real patches seen during training as prototypes and constructs the dense prediction map bas…

SegmentationSemantic Segmentation

ProtoSeg: Interpretable Semantic Segmentation with Prototypical Parts

2023-01-28 · Mikołaj Sacha, Dawid Rymarczyk, Łukasz Struski, Jacek Tabor 외

We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we ada…

DiversityImage SegmentationSegmentationSemantic Segmentation

WaveSleepNet: An Interpretable Network for Expert-like Sleep Staging

2024-04-11 · Yan Pei, Wei Luo

Although deep learning algorithms have proven their efficiency in automatic sleep staging, the widespread skepticism about their "black-box" nature has limited its clinical acceptance. In this study, we propose WaveSleep…

Decision MakingSleep Staging