Hierarchical Reinforcement Learning with Hindsight

2018-05-21 · ICLR 2019 5 · Andrew Levy, Robert Platt, Kate Saenko

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a sample efficient and automated fashion. Our approach combines universal value functions and hindsight learning, allowing agents to learn policies belonging to different time scales in parallel. We show that our method significantly accelerates learning in a variety of discrete and continuous tasks.

📄 PDF Abstract BibTeX arXiv:1805.08180

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

PIPER: Primitive-Informed Preference-based Hierarchical Reinforcement Learning via Hindsight Relabeling

2024-04-20 · Utsav Singh, Wesley A. Suttle, Brian M. Sadler, Vinay P. Namboodiri 외

In this work, we introduce PIPER: Primitive-Informed Preference-based Hierarchical reinforcement learning via Hindsight Relabeling, a novel approach that leverages preference-based learning to learn a reward model, and s…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning

Retrieval-Augmented Hierarchical in-Context Reinforcement Learning and Hindsight Modular Reflections for Task Planning with LLMs

2024-08-12 · Chuanneng Sun, Songjun Huang, Dario Pompili

Large Language Models (LLMs) have demonstrated remarkable abilities in various language tasks, making them promising candidates for decision-making in robotics. Inspired by Hierarchical Reinforcement Learning (HRL), we p…

Decision Making Hierarchical Reinforcement Learning In-Context Learning In-Context Reinforcement Learning+4

GCHR : Goal-Conditioned Hindsight Regularization for Sample-Efficient Reinforcement Learning

2025-08-08 · Xing Lei, Wenyan Yang, Kaiqiang Ke, Shentao Yang 외 arxiv

Goal-conditioned reinforcement learning (GCRL) with sparse rewards remains a fundamental challenge in reinforcement learning. While hindsight experience replay (HER) has shown promise by relabeling collected trajectories…

Reinforcement Learning

Adaptive Dialog Policy Learning with Hindsight and User Modeling

2020-05-07 · SIGDIAL (ACL) 2020 7 · Yan Cao, Keting Lu, Xiaoping Chen, Shiqi Zhang

Reinforcement learning methods have been used to compute dialog policies from language-based interaction experiences. Efficiency is of particular importance in dialog policy learning, because of the considerable cost of …

Reinforcement Learning (RL)

Generalized Hindsight for Reinforcement Learning

2020-02-26 · NeurIPS 2020 12 · Alexander C. Li, Lerrel Pinto, Pieter Abbeel

One of the key reasons for the high sample complexity in reinforcement learning (RL) is the inability to transfer knowledge from one task to another. In standard multi-task RL settings, low-reward data collected while tr…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)