SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathology
Introducing interpretability and reasoning into Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) analysis is challenging, given the complexity of gigapixel slides. Traditionally, MIL interpretability is limited to identifying salient regions deemed pertinent for downstream tasks, offering little insight to the end-user (pathologist) regarding the rationale behind these selections. To address this, we propose Self-Interpretable MIL (SI-MIL), a method intrinsically designed for interpretability from the very outset. SI-MIL employs a deep MIL framework to guide an interpretable branch grounded on handcrafted pathological features, facilitating linear predictions. Beyond identifying salient regions, SI-MIL uniquely provides feature-level interpretations rooted in pathological insights for WSIs. Notably, SI-MIL, with its linear prediction constraints, challenges the prevalent myth of an inevitable trade-off between model interpretability and performance, demonstrating competitive results compared to state-of-the-art methods on WSI-level prediction tasks across three cancer types. In addition, we thoroughly benchmark the local and global-interpretability of SI-MIL in terms of statistical analysis, a domain expert study, and desiderata of interpretability, namely, user-friendliness and faithfulness.
Code (1)
Tasks
Multiple Instance LearningSimilar Papers 제목 키워드 기반
Self-training of Machine Learning Models for Liver Histopathology: Generalization under Clinical Shifts
Histopathology images are gigapixel-sized and include features and information at different resolutions. Collecting annotations in histopathology requires highly specialized pathologists, making it expensive and time-con…
Neural Image Compression for Gigapixel Histopathology Image Analysis
We propose Neural Image Compression (NIC), a two-step method to build convolutional neural networks for gigapixel image analysis solely using weak image-level labels. First, gigapixel images are compressed using a neural…
Image CompressionMedical DiagnosisAgent Aggregator with Mask Denoise Mechanism for Histopathology Whole Slide Image Analysis
Histopathology analysis is the gold standard for medical diagnosis. Accurate classification of whole slide images (WSIs) and region-of-interests (ROIs) localization can assist pathologists in diagnosis. The gigapixel res…
ClassificationDenoisingMedical DiagnosisMultiple Instance Learning+2Kernel Attention Transformer (KAT) for Histopathology Whole Slide Image Classification
Transformer has been widely used in histopathology whole slide image (WSI) classification for the purpose of tumor grading, prognosis analysis, etc. However, the design of token-wise self-attention and positional embeddi…
Classificationimage-classificationImage ClassificationPrognosisSelf-similarity Student for Partial Label Histopathology Image Segmentation
Delineation of cancerous regions in gigapixel whole slide images (WSIs) is a crucial diagnostic procedure in digital pathology. This process is time-consuming because of the large search space in the gigapixel WSIs, caus…
DiagnosticImage SegmentationPseudo LabelSemantic Segmentation+1