paper-with-me

홈 › Papers

Privacy-Aware Continual Self-Supervised Learning on Multi-Window Chest Computed Tomography for Domain-Shift Robustness

2025-10-31 · Ren Tasai, Guang Li, Ren Togo, Takahiro Ogawa, Kenji Hirata, Minghui Tang, Takaaki Yoshimura, Hiroyuki Sugimori, Noriko Nishioka, Yukie Shimizu, Kohsuke Kudo, Miki Haseyama arxiv

We propose a novel continual self-supervised learning (CSSL) framework for simultaneously learning diverse features from multi-window-obtained chest computed tomography (CT) images and ensuring data privacy. Achieving a robust and highly generalizable model in medical image diagnosis is challenging, mainly because of issues, such as the scarcity of large-scale, accurately annotated datasets and domain shifts inherent to dynamic healthcare environments. Specifically, in chest CT, these domain shifts often arise from differences in window settings, which are optimized for distinct clinical purposes. Previous CSSL frameworks often mitigated domain shift by reusing past data, a typically impractical approach owing to privacy constraints. Our approach addresses these challenges by effectively capturing the relationship between previously learned knowledge and new information across different training stages through continual pretraining on unlabeled images. Specifically, by incorporating a latent replay-based mechanism into CSSL, our method mitigates catastrophic forgetting due to domain shifts during continual pretraining while ensuring data privacy. Additionally, we introduce a feature distillation technique that integrates Wasserstein distance-based knowledge distillation (WKD) and batch-knowledge ensemble (BKE), enhancing the ability of the model to learn meaningful, domain-shift-robust representations. Finally, we validate our approach using chest CT images obtained across two different window settings, demonstrating superior performance compared with other approaches.

📄 PDF Abstract BibTeX arXiv:2510.27213

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised LearningKnowledge DistillationContinual Pretraining

Similar Papers 제목 키워드 기반

Replay-free Online Continual Learning with Self-Supervised MultiPatches

2025-02-13 · Giacomo Cignoni, Andrea Cossu, Alex Gomez-Villa, Joost Van de Weijer 외

Online Continual Learning (OCL) methods train a model on a non-stationary data stream where only a few examples are available at a time, often leveraging replay strategies. However, usage of replay is sometimes forbidden…

Continual LearningSelf-Supervised Learning

InvCoSS: Inversion-driven Continual Self-supervised Learning in Medical Multi-modal Image Pre-training

2025-12-22 · Zihao Luo, Shaohao Rui, Zhenyu Tang, Guotai Wang 외 arxiv

Continual self-supervised learning (CSSL) in medical imaging trains a foundation model sequentially, alleviating the need for collecting multi-modal images for joint training and offering promising improvements in downst…

Self-Supervised Learning

Lamer-SSL: Layer-aware Mixture of LoRA Experts for Continual Multilingual Expansion of Self-supervised Models without Forgetting

2026-02-13 · Jing Xu, Minglin Wu, Xueyuan Chen, Xixin Wu 외 arxiv

Despite their impressive performance, self-supervised speech models often struggle to generalize to new languages and tend to forget previously acquired knowledge during continual training. To address this, we propose La…

Language IdentificationSpeech Recognition

Contrastive Continual Learning for Model Adaptability in Internet of Things

2026-02-04 · Ajesh Koyatan Chathoth arxiv

Internet of Things (IoT) deployments operate in nonstationary, dynamic environments where factors such as sensor drift, evolving user behavior, and heterogeneous user privacy requirements can affect application utility. …

Contrastive LearningContinual Learning

Domain-Aware Augmentations for Unsupervised Online General Continual Learning

2023-09-13 · Nicolas Michel, Romain Negrel, Giovanni Chierchia, Jean-François Bercher

Continual Learning has been challenging, especially when dealing with unsupervised scenarios such as Unsupervised Online General Continual Learning (UOGCL), where the learning agent has no prior knowledge of class bounda…

Continual LearningContrastive Learning