Continual Learning as Computationally Constrained Reinforcement Learning
An agent that efficiently accumulates knowledge to develop increasingly sophisticated skills over a long lifetime could advance the frontier of artificial intelligence capabilities. The design of such agents, which remains a long-standing challenge of artificial intelligence, is addressed by the subject of continual learning. This monograph clarifies and formalizes concepts of continual learning, introducing a framework and set of tools to stimulate further research.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual Learningreinforcement-learningReinforcement LearningSimilar Papers 제목 키워드 기반
The World Is Bigger! A Computationally-Embedded Perspective on the Big World Hypothesis
Continual learning is often motivated by the idea, known as the big world hypothesis, that "the world is bigger" than the agent. Recent problem formulations capture this idea by explicitly constraining an agent relative …
Reinforcement LearningContinual LearningJust-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updates
While Large Language Model (LLM) agents excel at general tasks, they inherently struggle with continual adaptation due to the frozen weights after deployment. Conventional reinforcement learning (RL) offers a solution bu…
Reinforcement LearningContinual LearningSafe Continual Reinforcement Learning Methods for Nonstationary Environments. Towards a Survey of the State of the Art
This work provides a state-of-the-art survey of continual safe online reinforcement learning (COSRL) methods. We discuss theoretical aspects, challenges, and open questions in building continual online safe reinforcement…
Reinforcement LearningContinual LearningContinually Learn to Map Visual Concepts to Large Language Models in Resource-constrained Environments
Learning continually from a stream of non-i.i.d. data is an open challenge in deep learning, even more so when working in resource-constrained environments such as embedded devices. Visual models that are continually upd…
Continual LearningLanguage ModelingLanguage ModellingLarge Language ModelContinual World: A Robotic Benchmark For Continual Reinforcement Learning
Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents…
Continual Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)