Structured State Space Models for Multiple Instance Learning in Digital Pathology
Multiple instance learning is an ideal mode of analysis for histopathology data, where vast whole slide images are typically annotated with a single global label. In such cases, a whole slide image is modelled as a collection of tissue patches to be aggregated and classified. Common models for performing this classification include recurrent neural networks and transformers. Although powerful compression algorithms, such as deep pre-trained neural networks, are used to reduce the dimensionality of each patch, the sequences arising from whole slide images remain excessively long, routinely containing tens of thousands of patches. Structured state space models are an emerging alternative for sequence modelling, specifically designed for the efficient modelling of long sequences. These models invoke an optimal projection of an input sequence into memory units that compress the entire sequence. In this paper, we propose the use of state space models as a multiple instance learner to a variety of problems in digital pathology. Across experiments in metastasis detection, cancer subtyping, mutation classification, and multitask learning, we demonstrate the competitiveness of this new class of models with existing state of the art approaches. Our code is available at https://github.com/MICS-Lab/s4_digital_pathology.
Code (1)
Tasks
Multiple Instance LearningState Space Modelswhole slide imagesSimilar Papers 제목 키워드 기반
MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models
Recently, pathological diagnosis has achieved superior performance by combining deep learning models with the multiple instance learning (MIL) framework using whole slide images (WSIs). However, the giga-pixeled nature o…
MambaMultiple Instance LearningState Space Modelswhole slide imagesImproving Multi-label Learning with Missing Labels by Structured Semantic Correlations
Multi-label learning has attracted significant interests in computer vision recently, finding applications in many vision tasks such as multiple object recognition and automatic image annotation. Associating multiple lab…
Missing LabelsMulti-Label LearningObject RecognitionGRASP: GRAph-Structured Pyramidal Whole Slide Image Representation
Cancer subtyping is one of the most challenging tasks in digital pathology, where Multiple Instance Learning (MIL) by processing gigapixel whole slide images (WSIs) has been in the spotlight of recent research. However, …
Multiple Instance Learningwhole slide imagesModeling Analog Dynamic Range Compressors using Deep Learning and State-space Models
We describe a novel approach for developing realistic digital models of dynamic range compressors for digital audio production by analyzing their analog prototypes. While realistic digital dynamic compressors are potenti…
Deep LearningState Space ModelsMultiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potential
Digital whole slides images contain an enormous amount of information providing a strong motivation for the development of automated image analysis tools. Particularly deep neural networks show high potential with respec…
Multiple Instance Learning