ProtoMIL: Multiple Instance Learning with Prototypical Parts for Whole-Slide Image Classification
Multiple Instance Learning (MIL) gains popularity in many real-life machine learning applications due to its weakly supervised nature. However, the corresponding effort on explaining MIL lags behind, and it is usually limited to presenting instances of a bag that are crucial for a particular prediction. In this paper, we fill this gap by introducing ProtoMIL, a novel self-explainable MIL method inspired by the case-based reasoning process that operates on visual prototypes. Thanks to incorporating prototypical features into objects description, ProtoMIL unprecedentedly joins the model accuracy and fine-grained interpretability, which we present with the experiments on five recognized MIL datasets.
Code (1)
Tasks
image-classificationImage ClassificationMultiple Instance LearningSimilar Papers 제목 키워드 기반
Multi-Scale Prototypical Transformer for Whole Slide Image Classification
Whole slide image (WSI) classification is an essential task in computational pathology. Despite the recent advances in multiple instance learning (MIL) for WSI classification, accurate classification of WSIs remains chal…
Classificationimage-classificationImage ClassificationMultiple Instance LearningLucidPPN: Unambiguous Prototypical Parts Network for User-centric Interpretable Computer Vision
Prototypical parts networks combine the power of deep learning with the explainability of case-based reasoning to make accurate, interpretable decisions. They follow the this looks like that reasoning, representing each …
ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognition
Prototypical part network (ProtoPNet) has drawn wide attention and boosted many follow-up studies due to its self-explanatory property for explainable artificial intelligence (XAI). However, when directly applying ProtoP…
Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizations
We present ProtoConcepts, a method for interpretable image classification combining deep learning and case-based reasoning using prototypical parts. Existing work in prototype-based image classification uses a "this look…
Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction
Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive…
DisentanglementSurvival Predictionwhole slide images