paper-with-me

홈 › Papers

Dual-Stage Invariant Continual Learning under Extreme Visual Sparsity

2026-03-27 · Rangya Zhang, Jiaping Xiao, Lu Bai, Yuhang Zhang, Mir Feroskhan arxiv

Continual learning seeks to maintain stable adaptation under non-stationary environments, yet this problem becomes particularly challenging in object detection, where most existing methods implicitly assume relatively balanced visual conditions. In extreme-sparsity regimes, such as those observed in space-based resident space object (RSO) detection scenarios, foreground signals are overwhelmingly dominated by background observations. Under such conditions, we analytically demonstrate that background-driven gradients destabilize the feature backbone during sequential domain shifts, causing progressive representation drift. This exposes a structural limitation of continual learning approaches relying solely on output-level distillation, as they fail to preserve intermediate representation stability. To address this, we propose a dual-stage invariant continual learning framework via joint distillation, enforcing structural and semantic consistency on both backbone representations and detection predictions, respectively, thereby suppressing error propagation at its source while maintaining adaptability. Furthermore, to regulate gradient statistics under severe imbalance, we introduce a sparsity-aware data conditioning strategy combining patch-based sampling and distribution-aware augmentation. Experiments on a high-resolution space-based RSO detection dataset show consistent improvement over established continual object detection methods, achieving an absolute gain of +4.0 mAP under sequential domain shifts.

📄 PDF Abstract BibTeX arXiv:2603.26190

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningObject Detection

Similar Papers 제목 키워드 기반

Confounder-Free Continual Learning via Recursive Feature Normalization

2025-07-11 · Yash Shah, Camila Gonzalez, Mohammad H. Abbasi, Qingyu Zhao 외 arxiv

Confounders are extraneous variables that affect both the input and the target, resulting in spurious correlations and biased predictions. There are recent advances in dealing with or removing confounders in traditional …

Continual Learning

DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning

2022-04-10 · Zifeng Wang, Zizhao Zhang, Sayna Ebrahimi, Ruoxi Sun 외

Continual learning aims to enable a single model to learn a sequence of tasks without catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store past pristine examples for experience repl…

Continual Learning

Adversarial Continual Learning for Multi-Domain Hippocampal Segmentation

2021-07-19 · Marius Memmel, Camila Gonzalez, Anirban Mukhopadhyay

Deep learning for medical imaging suffers from temporal and privacy-related restrictions on data availability. To still obtain viable models, continual learning aims to train in sequential order, as and when data is avai…

Continual LearningContinual Semantic SegmentationDisentanglementDomain Adaptation+2

DualHSIC: HSIC-Bottleneck and Alignment for Continual Learning

2023-04-30 · Zifeng Wang, Zheng Zhan, Yifan Gong, Yucai Shao 외

Rehearsal-based approaches are a mainstay of continual learning (CL). They mitigate the catastrophic forgetting problem by maintaining a small fixed-size buffer with a subset of data from past tasks. While most rehearsal…

Continual Learning

DARAD: Dual Adapters and Ranking-Aware Distillation for Continual Remote Sensing Image-Text Retrieval

2026-08-06 · Xi Chen, Xu Chen, Xiangyang Jia, Wei Wang 외 arxiv

With the rapid growth of Earth observation technologies, remote sensing archives are rapidly expanding, making remote sensing image-text retrieval (RS-ITR) increasingly important. However, continual RS-ITR remains challe…

Continual LearningText Retrieval