Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networks
Traditional image-based survival prediction models rely on discriminative patch labeling which make those methods not scalable to extend to large datasets. Recent studies have shown Multiple Instance Learning (MIL) framework is useful for histopathological images when no annotations are available in classification task. Different to the current image-based survival models that limit to key patches or clusters derived from Whole Slide Images (WSIs), we propose Deep Attention Multiple Instance Survival Learning (DeepAttnMISL) by introducing both siamese MI-FCN and attention-based MIL pooling to efficiently learn imaging features from the WSI and then aggregate WSI-level information to patient-level. Attention-based aggregation is more flexible and adaptive than aggregation techniques in recent survival models. We evaluated our methods on two large cancer whole slide images datasets and our results suggest that the proposed approach is more effective and suitable for large datasets and has better interpretability in locating important patterns and features that contribute to accurate cancer survival predictions. The proposed framework can also be used to assess individual patient's risk and thus assisting in delivering personalized medicine. Codes are available at https://github.com/uta-smile/DeepAttnMISL_MEDIA.
Code (1)
Tasks
Deep AttentionMultiple Instance LearningSurvival Predictionwhole slide imagesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
WSISA: Making Survival Prediction From Whole Slide Histopathological Images
Image-based precision medicine techniques can be used to better treat cancer patients. However, the gigapixel resolution of Whole Slide Histopathological Images (WSIs) makes traditional survival models computationally im…
PredictionSurvival AnalysisSurvival PredictionAttention-based Multiple Instance Learning for Survival Prediction on Lung Cancer Tissue Microarrays
Attention-based multiple instance learning (AMIL) algorithms have proven to be successful in utilizing gigapixel whole-slide images (WSIs) for a variety of different computational pathology tasks such as outcome predicti…
Multiple Instance LearningPredictionSurvival Predictionwhole slide imagesMHAttnSurv: Multi-Head Attention for Survival Prediction Using Whole-Slide Pathology Images
In pathology, whole-slide images (WSI) based survival prediction has attracted increasing interest. However, given the large size of WSIs and the lack of pathologist annotations, extracting the prognostic information fro…
Multiple Instance LearningPredictionPrognosisSurvival Prediction+1DPsurv: Dual-Prototype Evidential Fusion for Uncertainty-Aware and Interpretable Whole-Slide Image Survival Prediction
Pathology whole-slide images (WSIs) are widely used for cancer survival analysis because of their comprehensive histopathological information at both cellular and tissue levels, enabling quantitative, large-scale, and pr…
Deep Learning for interpretable end-to-end survival prediction in gastrointestinal cancer histopathology
Digitized histopathology slides contain a wealth of information, only a fraction of which is being used in clinical routine. Deep learning can extract subtle visual features from digitized slides and thus can infer clini…
Survival Predictionwhole slide images