Multi-Scale Attention-based Multiple Instance Learning for Classification of Multi-Gigapixel Histology Images
Histology images with multi-gigapixel of resolution yield rich information for cancer diagnosis and prognosis. Most of the time, only slide-level label is available because pixel-wise annotation is labour intensive task. In this paper, we propose a deep learning pipeline for classification in histology images. Using multiple instance learning, we attempt to predict the latent membrane protein 1 (LMP1) status of nasopharyngeal carcinoma (NPC) based on haematoxylin and eosin-stain (H&E) histology images. We utilised attention mechanism with residual connection for our aggregation layers. In our 3-fold cross-validation experiment, we achieved average accuracy, AUC and F1-score 0.936, 0.995 and 0.862, respectively. This method also allows us to examine the model interpretability by visualising attention scores. To the best of our knowledge, this is the first attempt to predict LMP1 status on NPC using deep learning.
Code (1)
Tasks
Deep LearningMultiple Instance LearningPrognosisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Scale Prototypical Transformer for Whole Slide Image Classification
Whole slide image (WSI) classification is an essential task in computational pathology. Despite the recent advances in multiple instance learning (MIL) for WSI classification, accurate classification of WSIs remains chal…
Classificationimage-classificationImage ClassificationMultiple Instance LearningAttention-Challenging Multiple Instance Learning for Whole Slide Image Classification
In the application of Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) classification, attention mechanisms often focus on a subset of discriminative instances, which are closely linked to overfitting…
image-classificationImage ClassificationMultiple Instance LearningHigh-resolution Image-based Malware Classification using Multiple Instance Learning
This paper proposes a novel method of classifying malware into families using high-resolution greyscale images and multiple instance learning to overcome adversarial binary enlargement. Current methods of visualisation-b…
ClassificationMalware ClassificationMultiple Instance LearningWSD-MIL: Window Scale Decay Multiple Instance Learning for Whole Slide Image Classification
In recent years, the integration of pre-trained foundational models with multiple instance learning (MIL) has improved diagnostic accuracy in computational pathology. However, existing MIL methods focus on optimizing fea…
Multiple Instance LearningComputational EfficiencyImage ClassificationMATT: A Multiple-instance Attention Mechanism for Long-tail Music Genre Classification
Imbalanced music genre classification is a crucial task in the Music Information Retrieval (MIR) field for identifying the long-tail, data-poor genre based on the related music audio segments, which is very prevalent in …
Genre classificationInformation RetrievalMusic Genre ClassificationMusic Information Retrieval+1