Slide-based Graph Collaborative Training for Histopathology Whole Slide Image Analysis
The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI yet ignores the possible inter-correlations between slides. As the development of tumors is a continuous process involving a series of histological, morphological, and genetic changes that accumulate over time, the similarities and differences between WSIs across various stages, grades, locations and patients should potentially contribute to the representation of WSIs and deserve to be taken into account in WSI modeling. To verify the advancement of introducing the slide inter-correlations into the representation learning of WSIs, we proposed a generic WSI analysis pipeline SlideGCD that can be adapted to any existing Multiple Instance Learning (MIL) frameworks and improve their performance. With the new paradigm, the prior knowledge of cancer development can participate in the end-to-end workflow, which concurrently initializes and refines the slide representation, as a guide for message passing in the slide-based graph. Extensive comparisons and experiments are conducted to validate the effectiveness and robustness of the proposed pipeline across 4 different tasks, including cancer subtyping, cancer staging, survival prediction, and gene mutation prediction, with 7 representative SOTA WSI analysis frameworks as backbones.
Code (1)
Tasks
Multiple Instance LearningRepresentation LearningSurvival PredictionSimilar Papers 제목 키워드 기반
Slideflow: Deep Learning for Digital Histopathology with Real-Time Whole-Slide Visualization
Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for…
Deep LearningHistopathological Image ClassificationHistopathological SegmentationImage Generation+4Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images
Automatic and accurate Gleason grading of histopathology tissue slides is crucial for prostate cancer diagnosis, treatment, and prognosis. Usually, histopathology tissue slides from different institutions show heterogene…
Domain AdaptationGeneral ClassificationPrognosisUnsupervised Domain Adaptation+1Multi-Scale Relational Graph Convolutional Network for Multiple Instance Learning in Histopathology Images
Graph convolutional neural networks have shown significant potential in natural and histopathology images. However, their use has only been studied in a single magnification or multi-magnification with late fusion. In or…
ManagementMultiple Instance Learningwhole slide imagesPRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathology
Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, whic…
whole slide imagesIntegrative Graph-Transformer Framework for Histopathology Whole Slide Image Representation and Classification
In digital pathology, the multiple instance learning (MIL) strategy is widely used in the weakly supervised histopathology whole slide image (WSI) classification task where giga-pixel WSIs are only labeled at the slide l…
Multiple Instance Learning