Reducing self-supervised learning complexity improves weakly-supervised classification performance in computational pathology
Deep Learning models have been successfully utilized to extract clinically actionable insights from routinely available histology data. Generally, these models require annotations performed by clinicians, which are scarce and costly to generate. The emergence of self-supervised learning (SSL) methods remove this barrier, allowing for large-scale analyses on non-annotated data. However, recent SSL approaches apply increasingly expansive model architectures and larger datasets, causing the rapid escalation of data volumes, hardware prerequisites, and overall expenses, limiting access to these resources to few institutions. Therefore, we investigated the complexity of contrastive SSL in computational pathology in relation to classification performance with the utilization of consumer-grade hardware. Specifically, we analyzed the effects of adaptations in data volume, architecture, and algorithms on downstream classification tasks, emphasizing their impact on computational resources. We trained breast cancer foundation models on a large public patient cohort and validated them on various downstream classification tasks in a weakly supervised manner on two external public patient cohorts. Our experiments demonstrate that we can improve downstream classification performance whilst reducing SSL training duration by 90%. In summary, we propose a set of adaptations which enable the utilization of SSL in computational pathology in non-resource abundant environments.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationSelf-Supervised LearningWeakly Supervised ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches
Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniq…
Human Activity RecognitionSelf-Supervised LearningMulti-Task LearningWeakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving
Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic mot…
Self-Supervised LearningAutonomous DrivingScene ParsingPoint CloudsEnhancing Weakly Supervised Semantic Segmentation for Fibrosis via Controllable Image Generation
Fibrotic Lung Disease (FLD) is a severe condition marked by lung stiffening and scarring, leading to respiratory decline. High-resolution computed tomography (HRCT) is critical for diagnosing and monitoring FLD; however,…
Image GenerationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic SegmentationHybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation
Weakly supervised segmentation enables model training from plane-level labels. Existing methods often rely on 2D encoders, neglecting the volumetric nature of medical data. We propose TranSamba, a hybrid Transformer-Mamb…
Object LocalizationSoft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation
We consider weakly supervised segmentation where only a fraction of pixels have ground truth labels (scribbles) and focus on a self-labeling approach optimizing relaxations of the standard unsupervised CRF/Potts loss on …