paper-with-me

Papers

Reducing self-supervised learning complexity improves weakly-supervised classification performance in computational pathology

2024-03-07 · Tim Lenz, Omar S. M. El Nahhas, Marta Ligero, Jakob Nikolas Kather

Deep Learning models have been successfully utilized to extract clinically actionable insights from routinely available histology data. Generally, these models require annotations performed by clinicians, which are scarce and costly to generate. The emergence of self-supervised learning (SSL) methods remove this barrier, allowing for large-scale analyses on non-annotated data. However, recent SSL approaches apply increasingly expansive model architectures and larger datasets, causing the rapid escalation of data volumes, hardware prerequisites, and overall expenses, limiting access to these resources to few institutions. Therefore, we investigated the complexity of contrastive SSL in computational pathology in relation to classification performance with the utilization of consumer-grade hardware. Specifically, we analyzed the effects of adaptations in data volume, architecture, and algorithms on downstream classification tasks, emphasizing their impact on computational resources. We trained breast cancer foundation models on a large public patient cohort and validated them on various downstream classification tasks in a weakly supervised manner on two external public patient cohorts. Our experiments demonstrate that we can improve downstream classification performance whilst reducing SSL training duration by 90%. In summary, we propose a set of adaptations which enable the utilization of SSL in computational pathology in non-resource abundant environments.

📄 PDF Abstract BibTeX arXiv:2403.04558

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationSelf-Supervised LearningWeakly Supervised Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Reducing Label Dependency in Human Activity Recognition with Wearables: From Supervised Learning to Novel Weakly Self-Supervised Approaches

2025-12-15 · Taoran Sheng, Manfred Huber arxiv

Human activity recognition (HAR) using wearable sensors has advanced through various machine learning paradigms, each with inherent trade-offs between performance and labeling requirements. While fully supervised techniq…

Human Activity RecognitionSelf-Supervised LearningMulti-Task Learning

Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving

2025-09-16 · Ruibo Li, Hanyu Shi, Zhe Wang, Guosheng Lin arxiv

Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic mot…

Self-Supervised LearningAutonomous DrivingScene ParsingPoint Clouds

Enhancing Weakly Supervised Semantic Segmentation for Fibrosis via Controllable Image Generation

2024-11-05 · Zhiling Yue, Yingying Fang, Liutao Yang, Nikhil Baid 외

Fibrotic Lung Disease (FLD) is a severe condition marked by lung stiffening and scarring, leading to respiratory decline. High-resolution computed tomography (HRCT) is critical for diagnosing and monitoring FLD; however,…

Image GenerationSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation

Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation

2025-12-11 · Yiheng Lyu, Lian Xu, Coen Arrow, Mohammed Bennamoun 외 arxiv

Weakly supervised segmentation enables model training from plane-level labels. Existing methods often rely on 2D encoders, neglecting the volumetric nature of medical data. We propose TranSamba, a hybrid Transformer-Mamb…

Object Localization

Soft Self-labeling and Potts Relaxations for Weakly-Supervised Segmentation

2025-07-02 · Zhongwen Zhang, Yuri Boykov arxiv

We consider weakly supervised segmentation where only a fraction of pixels have ground truth labels (scribbles) and focus on a self-labeling approach optimizing relaxations of the standard unsupervised CRF/Potts loss on …