Multi-Scale Prototypical Transformer for Whole Slide Image Classification
Whole slide image (WSI) classification is an essential task in computational pathology. Despite the recent advances in multiple instance learning (MIL) for WSI classification, accurate classification of WSIs remains challenging due to the extreme imbalance between the positive and negative instances in bags, and the complicated pre-processing to fuse multi-scale information of WSI. To this end, we propose a novel multi-scale prototypical Transformer (MSPT) for WSI classification, which includes a prototypical Transformer (PT) module and a multi-scale feature fusion module (MFFM). The PT is developed to reduce redundant instances in bags by integrating prototypical learning into the Transformer architecture. It substitutes all instances with cluster prototypes, which are then re-calibrated through the self-attention mechanism of the Trans-former. Thereafter, an MFFM is proposed to fuse the clustered prototypes of different scales, which employs MLP-Mixer to enhance the information communication between prototypes. The experimental results on two public WSI datasets demonstrate that the proposed MSPT outperforms all the compared algorithms, suggesting its potential applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Classificationimage-classificationImage ClassificationMultiple Instance LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SLPD: Slide-level Prototypical Distillation for WSIs
Improving the feature representation ability is the foundation of many whole slide pathological image (WSIs) tasks. Recent works have achieved great success in pathological-specific self-supervised learning (SSL). Howeve…
Representation LearningSelf-Supervised LearningA self-supervised framework for learning whole slide representations
Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with we…
DiagnosticLanguage ModellingMultiple Instance LearningRepresentation Learning+2Multi-scale Efficient Graph-Transformer for Whole Slide Image Classification
The multi-scale information among the whole slide images (WSIs) is essential for cancer diagnosis. Although the existing multi-scale vision Transformer has shown its effectiveness for learning multi-scale image represent…
image-classificationImage Classificationwhole slide imagesCascaded Cross-Attention Networks for Data-Efficient Whole-Slide Image Classification Using Transformers
Whole-Slide Imaging allows for the capturing and digitization of high-resolution images of histological specimen. An automated analysis of such images using deep learning models is therefore of high demand. The transform…
image-classificationImage Classificationwhole slide imagesProtoMIL: Multiple Instance Learning with Prototypical Parts for Whole-Slide Image Classification
Multiple Instance Learning (MIL) gains popularity in many real-life machine learning applications due to its weakly supervised nature. However, the corresponding effort on explaining MIL lags behind, and it is usually li…
image-classificationImage ClassificationMultiple Instance Learning