Multi-Scale Task Multiple Instance Learning for the Classification of Digital Pathology Images with Global Annotations
Whole slide images (WSIs) are high-resolution digitized images of tissue samples, stored including different magnification levels. WSIs datasets often include only global annotations, available thanks to pathology reports. Global annotations refer to global findings in the high-resolution image and do not include information about the location of the regions of interest or the magnification levels used to identify a finding. This fact can limit the training of machine learning models, as WSIs are usually very large and each magnification level includes different information about the tissue. This paper presents a Multi-Scale Task Multiple Instance Learning (MuSTMIL) method, allowing to better exploit data paired with global labels and to combine contextual and detailed information identified at several magnification levels. The method is based on a multiple instance learning framework and on a multi-task network, that combines features from several magnification levels and produces multiple predictions (a global one and one for each magnification level involved). MuSTMIL is evaluated on colon cancer images, on binary and multilabel classification. MuSTMIL shows an improvement in performance in comparison to both single scale and another multi-scale multiple instance learning algorithm, demonstrating that MuSTMIL can help to better deal with global labels targeting full and multi-scale images.
Code (0)
등록된 구현이 없습니다.
Tasks
Multiple Instance Learningwhole slide imagesSimilar Papers 제목 키워드 기반
Multi-Scale Prototypical Transformer for Whole Slide Image Classification
Whole slide image (WSI) classification is an essential task in computational pathology. Despite the recent advances in multiple instance learning (MIL) for WSI classification, accurate classification of WSIs remains chal…
Classificationimage-classificationImage ClassificationMultiple Instance LearningMulti-Instance Multi-Scale CNN for Medical Image Classification
Deep learning for medical image classification faces three major challenges: 1) the number of annotated medical images for training are usually small; 2) regions of interest (ROIs) are relatively small with unclear bound…
ClassificationGeneral Classificationimage-classificationImage Classification+2A Multi-scale Multiple Instance Video Description Network
Generating natural language descriptions for in-the-wild videos is a challenging task. Most state-of-the-art methods for solving this problem borrow existing deep convolutional neural network (CNN) architectures (AlexNet…
Image SegmentationMultiple Instance LearningSemantic SegmentationSentence+1Solving the multiple instance problem with axis-parallel rectangles
The multiple instance problem arises in tasks where the training examples are ambiguous: a single example object may have many alternative feature vectors (instances) that describe it, and yet only one of those feature v…
ObjectFeature-Distributed SVRG for High-Dimensional Linear Classification
Linear classification has been widely used in many high-dimensional applications like text classification. To perform linear classification for large-scale tasks, we often need to design distributed learning methods on a…
ClassificationGeneral Classificationtext-classificationText Classification+1