Selective Attention-based Modulation for Continual Learning
We present SAM, a biologically-plausible selective attention-driven modulation approach to enhance classification models in a continual learning setting. Inspired by neurophysiological evidence that the primary visual cortex does not contribute to object manifold untangling for categorization and that primordial attention biases are still embedded in the modern brain, we propose to employ auxiliary saliency prediction features as a modulation signal to drive and stabilize the learning of a sequence of non-i.i.d. classification tasks. Experimental results confirm that SAM effectively enhances the performance (in some cases up to about twenty percent points) of state-of-the-art continual learning methods, both in class-incremental and task-incremental settings. Moreover, we show that attention-based modulation successfully encourages the learning of features that are more robust to the presence of spurious features and to adversarial attacks than baseline methods. Code is available at: https://github.com/perceivelab/SAM.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningSaliency PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Strong attentional modulation of V1/V2 activity implements a robust, contrast-invariant control mechanism for selective information processing
When selective attention is devoted to one of multiple stimuli within receptive fields of neurons in visual area V4, cells respond as if only the attended stimulus was present. The underlying neural mechanisms are still …
Attention Distraction: Watermark Removal Through Continual Learning with Selective Forgetting
Fine-tuning attacks are effective in removing the embedded watermarks in deep learning models. However, when the source data is unavailable, it is challenging to just erase the watermark without jeopardizing the model pe…
Continual LearningSEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models
Continual learning (CL) is crucial for language models to dynamically adapt to the evolving real-world demands. To mitigate the catastrophic forgetting problem in CL, data replay has been proven a simple and effective st…
Continual LearningBayesian Optimized Continual Learning with Attention Mechanism
Though neural networks have achieved much progress in various applications, it is still highly challenging for them to learn from a continuous stream of tasks without forgetting. Continual learning, a new learning paradi…
Bayesian OptimizationContinual LearningContinual Learning with Query-Only Attention
Continual learning involves learning from a stream of data without repetition of data points, a scenario that is inherently complex due to distributional shift across tasks. We propose a query-only attention mechanism th…
Continual Learning