Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition and Selective Transfer
We introduce the eigentask framework for lifelong learning. An eigentask is a pairing of a skill that solves a set of related tasks with a generative model that can sample from the skill's input space. The model extends generative replay approaches, which have mainly been used to avoid catastrophic forgetting, to also address other lifelong learning goals such as forward knowledge transfer. We propose a wake-sleep cycle of alternating task learning and knowledge consolidation for learning in our framework, and instantiate it for lifelong supervised learning and lifelong RL. We achieve performance comparable to the state-of-the-art in supervised continual learning benchmarks, and show encouraging preliminary results for forward knowledge transfer in a lifelong RL application in the video game Starcraft~2.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningLifelong learningStarcraftTransfer LearningSimilar Papers 제목 키워드 기반
Lifelong Learning using Eigentasks: Task Separation, Skill Acquisition, and Selective Transfer
We introduce the eigentask framework for lifelong learning. An eigentask is a pairing of a skill that solves a set of related tasks, paired with a generative model that can sample from the skill's input space. The framew…
Continual LearningLifelong learningTransfer LearningT2S: Tokenized Skill Scaling for Lifelong Imitation Learning
The main challenge in lifelong imitation learning lies in the balance between mitigating catastrophic forgetting of previous skills while maintaining sufficient capacity for acquiring new ones. However, current approache…
Think Small, Act Big: Primitive Prompt Learning for Lifelong Robot Manipulation
Building a lifelong robot that can effectively leverage prior knowledge for continuous skill acquisition remains significantly challenging. Despite the success of experience replay and parameter-efficient methods in alle…
Prompt LearningRobot ManipulationTransfer LearningMathematical model bridges disparate timescales of lifelong learning
Lifelong learning occurs on timescales ranging from minutes to decades. People can lose themselves in a new skill, practicing for hours until exhausted. And they can pursue mastery over days or decades, perhaps abandonin…
Lifelong learningmodelSPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulation
Real-world robot manipulation in dynamic unstructured environments requires lifelong adaptability to evolving objects, scenes and tasks. Traditional imitation learning relies on static training paradigms, which are ill-s…
Action GenerationImitation LearningRobot ManipulationTransfer Learning