Beyond Patches: Mining Interpretable Part-Prototypes for Explainable AI
Deep learning has provided considerable advancements for multimedia systems, yet the interpretability of deep models remains a challenge. State-of-the-art post-hoc explainability methods, such as GradCAM, provide visual interpretation based on heatmaps but lack conceptual clarity. Prototype-based approaches, like ProtoPNet and PIPNet, offer a more structured explanation but rely on fixed patches, limiting their robustness and semantic consistency. To address these limitations, a part-prototypical concept mining network (PCMNet) is proposed that dynamically learns interpretable prototypes from meaningful regions. PCMNet clusters prototypes into concept groups, creating semantically grounded explanations without requiring additional annotations. Through a joint process of unsupervised part discovery and concept activation vector extraction, PCMNet effectively captures discriminative concepts and makes interpretable classification decisions. Our extensive experiments comparing PCMNet against state-of-the-art methods on multiple datasets show that it can provide a high level of interpretability, stability, and robustness under clean and occluded scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Unsupervised Part DiscoverySimilar Papers 제목 키워드 기반
PIP-Net: Patch-Based Intuitive Prototypes for Interpretable Image Classification
Interpretable methods based on prototypical patches recognize various components in an image in order to explain their reasoning to humans. However, existing prototype-based methods can learn prototypes that are not …
Decision Makingimage-classificationImage ClassificationPiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis
Background and Objective: Prototype-based methods improve interpretability by learning fine-grained part-prototypes; however, their visualization in the input pixel space is not always consistent with human-understandabl…
Contrastive LearningDiagnosticimage-classificationImage ClassificationMulti-Scale Grouped Prototypes for Interpretable Semantic Segmentation
Prototypical part learning is emerging as a promising approach for making semantic segmentation interpretable. The model selects real patches seen during training as prototypes and constructs the dense prediction map bas…
SegmentationSemantic SegmentationProtoSeg: Interpretable Semantic Segmentation with Prototypical Parts
We introduce ProtoSeg, a novel model for interpretable semantic image segmentation, which constructs its predictions using similar patches from the training set. To achieve accuracy comparable to baseline methods, we ada…
DiversityImage SegmentationSegmentationSemantic SegmentationWaveSleepNet: An Interpretable Network for Expert-like Sleep Staging
Although deep learning algorithms have proven their efficiency in automatic sleep staging, the widespread skepticism about their "black-box" nature has limited its clinical acceptance. In this study, we propose WaveSleep…
Decision MakingSleep Staging