Efficient Parameter Mining and Freezing for Continual Object Detection
Continual Object Detection is essential for enabling intelligent agents to interact proactively with humans in real-world settings. While parameter-isolation strategies have been extensively explored in the context of continual learning for classification, they have yet to be fully harnessed for incremental object detection scenarios. Drawing inspiration from prior research that focused on mining individual neuron responses and integrating insights from recent developments in neural pruning, we proposed efficient ways to identify which layers are the most important for a network to maintain the performance of a detector across sequential updates. The presented findings highlight the substantial advantages of layer-level parameter isolation in facilitating incremental learning within object detection models, offering promising avenues for future research and application in real-world scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningIncremental LearningObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Uncertainty-based Continual Learning with Adaptive Regularization
We introduce a new neural network-based continual learning algorithm, dubbed as Uncertainty-regularized Continual Learning (UCL), which builds on traditional Bayesian online learning framework with variational inference.…
Continual LearningReinforcement LearningVariational InferenceAttribution-Guided Continual Learning for Large Language Models
Large language models (LLMs) often suffer from catastrophic forgetting in continual learning: after learning new tasks sequentially, they perform worse on earlier tasks. Existing methods mitigate catastrophic forgetting …
Continual LearningExpandable, Compressible, Mineable: Open-World Thermal Image Restoration
In open-world settings, thermal infrared (TIR) image degradations continuously emerge and evolve, while most existing all-in-one restoration methods are built on a closed-set assumption and struggle to continually adapt …
Continual LearningImage RestorationSCALE: Upscaled Continual Learning of Large Language Models
We revisit continual pre-training for large language models and argue that progress now depends more on scaling the right structure than on scaling parameters alone. We introduce SCALE, a width upscaling architecture tha…
Continual LearningBeyond Freezing: Sparse Tuning Enhances Plasticity in Continual Learning with Pre-Trained Models
Continual Learning with Pre-trained Models holds great promise for efficient adaptation across sequential tasks. However, most existing approaches freeze PTMs and rely on auxiliary modules like prompts or adapters, limit…
Continual Learning