Shaping Proto-Value Functions via Rewards

2015-11-27 · Chandrashekar Lakshmi Narayanan, Raj Kumar Maity, Shalabh Bhatnagar

In this paper, we combine task-dependent reward shaping and task-independent proto-value functions to obtain reward dependent proto-value functions (RPVFs). In constructing the RPVFs we are making use of the immediate rewards which are available during the sampling phase but are not used in the PVF construction. We show via experiments that learning with an RPVF based representation is better than learning with just reward shaping or PVFs. In particular, when the state space is symmetrical and the rewards are asymmetrical, the RPVF capture the asymmetry better than the PVFs.

📄 PDF Abstract BibTeX arXiv:1511.08589

Code (0)

등록된 구현이 없습니다.

BAMDP Shaping: a Unified Theoretical Framework for Intrinsic Motivation and Reward Shaping

2024-09-09 · Aly Lidayan, Michael Dennis, Stuart Russell

Intrinsic motivation (IM) and reward shaping are common methods for guiding the exploration of reinforcement learning (RL) agents by adding pseudo-rewards. Designing these rewards is challenging, however, and they can co…

Reinforcement Learning (RL)

Shaping Advice in Deep Reinforcement Learning

2022-02-19 · Baicen Xiao, Bhaskar Ramasubramanian, Radha Poovendran

Reinforcement learning involves agents interacting with an environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the quality of actions that they…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Shaping Advice in Deep Multi-Agent Reinforcement Learning

2021-03-29 · Baicen Xiao, Bhaskar Ramasubramanian, Radha Poovendran

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate fe…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Locally-Guided Actor-Critic: Training a Goal-conditioned Actor with a Subgoal-aware Critic

2026-08-31 · Olivier Serris, Stéphane Doncieux, Olivier Sigaud arxiv

Goal-conditioned reinforcement learning struggles with long horizons when rewards are sparse. While a planner can provide subgoals to guide a low-level policy, its use at test time may introduce practical subgoal managem…

Reinforcement Learning

Maximum Expected Hitting Cost of a Markov Decision Process and Informativeness of Rewards

2019-07-03 · Falcon Z. Dai, Matthew R. Walter

We propose a new complexity measure for Markov decision processes (MDPs), the maximum expected hitting cost (MEHC). This measure tightens the closely related notion of diameter [JOA10] by accounting for the reward struct…

Informativeness