Lifelong Learning with a Changing Action Set
In many real-world sequential decision making problems, the number of available actions (decisions) can vary over time. While problems like catastrophic forgetting, changing transition dynamics, changing rewards functions, etc. have been well-studied in the lifelong learning literature, the setting where the action set changes remains unaddressed. In this paper, we present an algorithm that autonomously adapts to an action set whose size changes over time. To tackle this open problem, we break it into two problems that can be solved iteratively: inferring the underlying, unknown, structure in the space of actions and optimizing a policy that leverages this structure. We demonstrate the efficiency of this approach on large-scale real-world lifelong learning problems.
Code (1)
Tasks
Decision MakingLifelong learningSequential Decision MakingSimilar Papers 제목 키워드 기반
Reset-Free Lifelong Learning with Skill-Space Planning
The objective of lifelong reinforcement learning (RL) is to optimize agents which can continuously adapt and interact in changing environments. However, current RL approaches fail drastically when environments are non-st…
Lifelong learningMuJoCoReinforcement Learning (RL)Lifelong Computing
Computing systems form the backbone of many aspects of our life, hence they are becoming as vital as water, electricity, and road infrastructures for our society. Yet, engineering long running computing systems that achi…
Self-LearningLifelong Control of Off-grid Microgrid with Model Based Reinforcement Learning
The lifelong control problem of an off-grid microgrid is composed of two tasks, namely estimation of the condition of the microgrid devices and operational planning accounting for the uncertainties by forecasting the fut…
Model-based Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM
Service robots should be able to operate autonomously in dynamic and daily changing environments over an extended period of time. While Simultaneous Localization And Mapping (SLAM) is one of the most fundamental problems…
BenchmarkingPose EstimationSimultaneous Localization and MappingEvaluation of Lifelong Learning Systems
Current intelligent systems need the expensive support of machine learning experts to sustain their performance level when used on a daily basis. To reduce this cost, i.e. remaining free from any machine learning expert,…
BIG-bench Machine LearningLifelong learning