Tackling Non-forgetting and Forward Transfer with a Unified Lifelong Learning Approach
Humans are the best example of agents that can learn a variety of skills incrementally over the course of their lives, and imbuing machines with this skill is the goal of lifelong machine learning. Ideally, lifelong learning should achieve non-forgetting, forward and backward transfer, avoid confusion, support few-shot learning, and so on. In previous approaches, the focus has been given to subsets of these properties, often by fitting together with an array of separate mechanisms. In this work, we propose a simple yet powerful unified framework that supports almost all of these properties through {\em one} central consolidation mechanism. We then describe a particular instance of this framework designed to support non-forgetting and forward transfer. This novel approach works by efficiently locating sparse neural sub-networks and controlling their consolidation during lifelong learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningLifelong learningSimilar Papers 제목 키워드 기반
A Unified Framework for Lifelong Learning in Deep Neural Networks
Humans can learn a variety of concepts and skills incrementally over the course of their lives while exhibiting an array of desirable properties, such as non-forgetting, concept rehearsal, forward transfer and backward t…
Few-Shot LearningLifelong learningGAN Memory with No Forgetting
As a fundamental issue in lifelong learning, catastrophic forgetting is directly caused by inaccessible historical data; accordingly, if the data (information) were memorized perfectly, no forgetting should be expected. …
FormLifelong learningLifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective Transfer
We introduce the eigentask framework for lifelong learning. An eigentask is a pairing of a skill that solves a set of related tasks, paired with a generative model that can sample from the skill's input space. The framew…
Continual LearningLifelong learningTransfer LearningLifelong Learning using Eigentasks: Task Separation, Skill Acquisition and Selective Transfer
We introduce the eigentask framework for lifelong learning. An eigentask is a pairing of a skill that solves a set of related tasks with a generative model that can sample from the skill's input space. The model extends …
Continual LearningLifelong learningStarcraftTransfer LearningTowards Training Recurrent Neural Networks for Lifelong Learning
Catastrophic forgetting and capacity saturation are the central challenges of any parametric lifelong learning system. In this work, we study these challenges in the context of sequential supervised learning with an emph…
Lifelong learning