Weakly-supervised learning for image-based classification of primary melanomas into genomic immune subgroups
Determining early-stage prognostic markers and stratifying patients for effective treatment are two key challenges for improving outcomes for melanoma patients. Previous studies have used tumour transcriptome data to stratify patients into immune subgroups, which were associated with differential melanoma specific survival and potential treatment strategies. However, acquiring transcriptome data is a time-consuming and costly process. Moreover, it is not routinely used in the current clinical workflow. Here we attempt to overcome this by developing deep learning models to classify gigapixel H&E stained pathology slides, which are well established in clinical workflows, into these immune subgroups. Previous subtyping approaches have employed supervised learning which requires fully annotated data, or have only examined single genetic mutations in melanoma patients. We leverage a multiple-instance learning approach, which only requires slide-level labels and uses an attention mechanism to highlight regions of high importance to the classification. Moreover, we show that pathology-specific self-supervised models generate better representations compared to pathology-agnostic models for improving our model performance, achieving a mean AUC of 0.76 for classifying histopathology images as high or low immune subgroups. We anticipate that this method may allow us to find new biomarkers of high importance and could act as a tool for clinicians to infer the immune landscape of tumours and stratify patients, without needing to carry out additional expensive genetic tests.
Code (0)
등록된 구현이 없습니다.
Tasks
Multiple Instance LearningWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images -- Nevus & Melanoma
Automated region of interest detection in histopathological image analysis is a challenging and important topic with tremendous potential impact on clinical practice. The deep-learning methods used in computational patho…
medical image detectionwhole slide imagesWAL-Net: Weakly supervised auxiliary task learning network for carotid plaques classification
The classification of carotid artery ultrasound images is a crucial means for diagnosing carotid plaques, holding significant clinical relevance for predicting the risk of stroke. Recent research suggests that utilizing …
ClassificationSegmentationWeakly-supervised LearningRegion of Interest Detection in Melanocytic Skin Tumor Whole Slide Images
Automated region of interest detection in histopathological image analysis is a challenging and important topic with tremendous potential impact on clinical practice. The deep-learning methods used in computational patho…
medical image detectionwhole slide imagesA Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Context
Prior skin image datasets have not addressed patient-level information obtained from multiple skin lesions from the same patient. Though artificial intelligence classification algorithms have achieved expert-level perfor…
General ClassificationWeakly Supervised Object Localization on grocery shelves using simple FCN and Synthetic Dataset
We propose a weakly supervised method using two algorithms to predict object bounding boxes given only an image classification dataset. First algorithm is a simple Fully Convolutional Network (FCN) trained to classify ob…
Decoderimage-classificationImage ClassificationObject+5