A Theory for Knowledge Transfer in Continual Learning
Continual learning of a stream of tasks is an active area in deep neural networks. The main challenge investigated has been the phenomenon of catastrophic forgetting or interference of newly acquired knowledge with knowledge from previous tasks. Recent work has investigated forward knowledge transfer to new tasks. Backward transfer for improving knowledge gained during previous tasks has received much less attention. There is in general limited understanding of how knowledge transfer could aid tasks learned continually. We present a theory for knowledge transfer in continual supervised learning, which considers both forward and backward transfer. We aim at understanding their impact for increasingly knowledgeable learners. We derive error bounds for each of these transfer mechanisms. These bounds are agnostic to specific implementations (e.g. deep neural networks). We demonstrate that, for a continual learner that observes related tasks, both forward and backward transfer can contribute to an increasing performance as more tasks are observed.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningTransfer LearningSimilar Papers 제목 키워드 기반
Continual Learning of Natural Language Processing Tasks: A Survey
Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned k…
Continual LearningSurveyTransfer LearningDon't forget, there is more than forgetting: new metrics for Continual Learning
Continual learning consists of algorithms that learn from a stream of data/tasks continuously and adaptively thought time, enabling the incremental development of ever more complex knowledge and skills. The lack of conse…
AttributeComputational EfficiencyContinual LearningTransfer LearningExploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfer
Open-World Continual Learning (OWCL) is a challenging paradigm where models must incrementally learn new knowledge without forgetting while operating under an open-world assumption. This requires handling incomplete trai…
Continual LearningTransfer LearningContinual Prompt Tuning for Dialog State Tracking
A desirable dialog system should be able to continually learn new skills without forgetting old ones, and thereby adapt to new domains or tasks in its life cycle. However, continually training a model often leads to a we…
Continual Learningdialog state trackingTransfer LearningContinual Prompt Tuning for Dialog State Tracking
A desirable dialog system should be able to continually learn new skills without forgetting old ones, and thereby adapt to new domains or tasks in its life cycle. However, continually training a model often leads to a we…
Continual Learningdialog state trackingTransfer Learning