Recall-Oriented Continual Learning with Generative Adversarial Meta-Model
The stability-plasticity dilemma is a major challenge in continual learning, as it involves balancing the conflicting objectives of maintaining performance on previous tasks while learning new tasks. In this paper, we propose the recall-oriented continual learning framework to address this challenge. Inspired by the human brain's ability to separate the mechanisms responsible for stability and plasticity, our framework consists of a two-level architecture where an inference network effectively acquires new knowledge and a generative network recalls past knowledge when necessary. In particular, to maximize the stability of past knowledge, we investigate the complexity of knowledge depending on different representations, and thereby introducing generative adversarial meta-model (GAMM) that incrementally learns task-specific parameters instead of input data samples of the task. Through our experiments, we show that our framework not only effectively learns new knowledge without any disruption but also achieves high stability of previous knowledge in both task-aware and task-agnostic learning scenarios. Our code is available at: https://github.com/bigdata-inha/recall-oriented-cl-framework.
Code (1)
Tasks
Continual LearningIncremental LearningSimilar Papers 제목 키워드 기반
Incremental Concept Learning via Online Generative Memory Recall
The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previousl…
class-incremental learningClass Incremental LearningGenerative Adversarial NetworkIncremental LearningHypernetworks for Continual Semi-Supervised Learning
Learning from data sequentially arriving, possibly in a non i.i.d. way, with changing task distribution over time is called continual learning. Much of the work thus far in continual learning focuses on supervised learni…
Continual LearningGenerative Adversarial NetworkSplit-CIFAR-10Continual Learning of Generative Models with Limited Data: From Wasserstein-1 Barycenter to Adaptive Coalescence
Learning generative models is challenging for a network edge node with limited data and computing power. Since tasks in similar environments share model similarity, it is plausible to leverage pre-trained generative mode…
Continual LearningQuantizationTransfer LearningRECALL: Replay-based Continual Learning in Semantic Segmentation
Deep networks allow to obtain outstanding results in semantic segmentation, however they need to be trained in a single shot with a large amount of data. Continual learning settings where new classes are learned in incre…
Continual LearningGenerative Adversarial NetworkSemantic SegmentationFoCL: Feature-Oriented Continual Learning for Generative Models
In this paper, we propose a general framework in continual learning for generative models: Feature-oriented Continual Learning (FoCL). Unlike previous works that aim to solve the catastrophic forgetting problem by introd…
Continual LearningIncremental Learning