Decision-Focused Model-based Reinforcement Learning for Reward Transfer
Model-based reinforcement learning (MBRL) provides a way to learn a transition model of the environment, which can then be used to plan personalized policies for different patient cohorts and to understand the dynamics involved in the decision-making process. However, standard MBRL algorithms are either sensitive to changes in the reward function or achieve suboptimal performance on the task when the transition model is restricted. Motivated by the need to use simple and interpretable models in critical domains such as healthcare, we propose a novel robust decision-focused (RDF) algorithm that learns a transition model that achieves high returns while being robust to changes in the reward function. We demonstrate our RDF algorithm can be used with several model classes and planning algorithms. We also provide theoretical and empirical evidence, on a variety of simulators and real patient data, that RDF can learn simple yet effective models that can be used to plan personalized policies.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingModel-based Reinforcement Learningreinforcement-learningReinforcement LearningSimilar Papers 제목 키워드 기반
Self-Supervised Reinforcement Learning that Transfers using Random Features
Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to gen…
Decision MakingModel Predictive Controlreinforcement-learningReinforcement Learning+1Hierarchical reinforcement learning for efficent exploration and transfer
Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate explor…
Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Hierarchical reinforcement learning for efficient exploration and transfer
Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate explor…
Efficient ExplorationHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning+1A Multiplicative Value Function for Safe and Efficient Reinforcement Learning
An emerging field of sequential decision problems is safe Reinforcement Learning (RL), where the objective is to maximize the reward while obeying safety constraints. Being able to handle constraints is essential for dep…
Navigatereinforcement-learningReinforcement LearningReinforcement Learning (RL)+2Learning Robust Rewards with Adversarial Inverse Reinforcement Learning
Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforce…
Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1