Bayesian Transfer Reinforcement Learning with Prior Knowledge Rules

2018-09-30 · Michalis K. Titsias, Sotirios Nikoloutsopoulos

We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information with prior knowledge, thus allowing to achieve transfer learning across tasks. The resulting method is flexible and it can be easily incorporated to any standard off-policy and on-policy algorithms, such as those based on temporal differences and policy gradients. We develop a specific instance of this Bayesian transfer RL framework by expressing prior knowledge as general deterministic rules that can be useful in a large variety of tasks, such as navigation tasks. Also, we elaborate more on recent probabilistic and entropy-regularised RL by developing a novel temporal learning algorithm and show how to combine it with Bayesian transfer RL. Finally, we demonstrate our method for solving mazes and show that significant speed ups can be obtained.

📄 PDF Abstract BibTeX arXiv:1810.00468

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer LearningTransfer Reinforcement Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

PAC-Bayesian Policy Evaluation for Reinforcement Learning

2012-02-14 · Mahdi Milani Fard, Joelle Pineau, Csaba Szepesvari

Bayesian priors offer a compact yet general means of incorporating domain knowledge into many learning tasks. The correctness of the Bayesian analysis and inference, however, largely depends on accuracy and correctness o…

Model Selection reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Model-based Bayesian Reinforcement Learning for Dialogue Management

2013-04-05 · Pierre Lison

Reinforcement learning methods are increasingly used to optimise dialogue policies from experience. Most current techniques are model-free: they directly estimate the utility of various actions, without explicit model of…

Bayesian Inference Dialogue Management Management model+3

Bayesian Neural Networks with Domain Knowledge Priors

2024-02-20 · Dylan Sam, Rattana Pukdee, Daniel P. Jeong, Yewon Byun 외

Bayesian neural networks (BNNs) have recently gained popularity due to their ability to quantify model uncertainty. However, specifying a prior for BNNs that captures relevant domain knowledge is often extremely challeng…

Fairness Variational Inference

Bayesian Exploration for Lifelong Reinforcement Learning

2021-09-29 · Haotian Fu, Shangqun Yu, Michael Littman, George Konidaris

A central question in reinforcement learning (RL) is how to leverage prior knowledge to accelerate learning in new tasks. We propose a Bayesian exploration method for lifelong reinforcement learning (BLRL) that aims to …

Lifelong learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Bayesian Inverse Reinforcement Learning for Collective Animal Movement

2020-09-08 · Toryn L. J. Schafer, Christopher K. Wikle, Mevin B. Hooten

Agent-based methods allow for defining simple rules that generate complex group behaviors. The governing rules of such models are typically set a priori and parameters are tuned from observed behavior trajectories. Inste…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)