Parameterized Exploration

2019-07-13 · Jesse Clifton, Lili Wu, Eric Laber

We introduce Parameterized Exploration (PE), a simple family of methods for model-based tuning of the exploration schedule in sequential decision problems. Unlike common heuristics for exploration, our method accounts for the time horizon of the decision problem as well as the agent's current state of knowledge of the dynamics of the decision problem. We show our method as applied to several common exploration techniques has superior performance relative to un-tuned counterparts in Bernoulli and Gaussian multi-armed bandits, contextual bandits, and a Markov decision process based on a mobile health (mHealth) study. We also examine the effects of the accuracy of the estimated dynamics model on the performance of PE.

📄 PDF Abstract BibTeX arXiv:1907.06090

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Armed Bandits

Active exploration in parameterized reinforcement learning

2016-10-06 · Mehdi Khamassi, Costas Tzafestas

Online model-free reinforcement learning (RL) methods with continuous actions are playing a prominent role when dealing with real-world applications such as Robotics. However, when confronted to non-stationary environmen…

Meta-Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Parameterized Indexed Value Function for Efficient Exploration in Reinforcement Learning

2019-12-23 · Tian Tan, Zhihan Xiong, Vikranth R. Dwaracherla

It is well known that quantifying uncertainty in the action-value estimates is crucial for efficient exploration in reinforcement learning. Ensemble sampling offers a relatively computationally tractable way of doing thi…

Efficient Exploration reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Extending Fourier Neural Operators for Modeling Parameterized and Coupled PDEs

2026-07-26 · Cheng Jing, Uvini Balasuriya Mudiyanselage, Abhishek Verma, Kallol Bera 외 arxiv

Parameterized and coupled partial differential equations (PDEs) are central to modeling phenomena in science and engineering, yet neural operator methods that address both aspects remain limited. We extend Fourier neural…

Accelerating Robotic Reinforcement Learning via Parameterized Action Primitives

2021-10-28 · NeurIPS 2021 12 · Murtaza Dalal, Deepak Pathak, Ruslan Salakhutdinov

Despite the potential of reinforcement learning (RL) for building general-purpose robotic systems, training RL agents to solve robotics tasks still remains challenging due to the difficulty of exploration in purely conti…

Efficient Exploration reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robots

2013-01-21 · Adrien Baranes, Pierre-Yves Oudeyer

We introduce the Self-Adaptive Goal Generation - Robust Intelligent Adaptive Curiosity (SAGG-RIAC) architecture as an intrinsi- cally motivated goal exploration mechanism which allows active learning of inverse models in…

Active Learning