Implicit Policy for Reinforcement Learning

2018-06-10 · Yunhao Tang, Shipra Agrawal

We introduce Implicit Policy, a general class of expressive policies that can flexibly represent complex action distributions in reinforcement learning, with efficient algorithms to compute entropy regularized policy gradients. We empirically show that, despite its simplicity in implementation, entropy regularization combined with a rich policy class can attain desirable properties displayed under maximum entropy reinforcement learning framework, such as robustness and multi-modality.

📄 PDF Abstract BibTeX arXiv:1806.06798

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Policy Tree Network

2019-09-25 · Zac Wellmer, Sepanta Zeighami, James Kwok

Decision-time planning policies with implicit dynamics models have been shown to work in discrete action spaces with Q learning. However, decision-time planning with implicit dynamics models in continuous action space ha…

Model-based Reinforcement Learning MuJoCo Policy Gradient Methods Q-Learning+3

Implicit Distributional Reinforcement Learning

2020-07-13 · NeurIPS 2020 12 · Yuguang Yue, Zhendong Wang, Mingyuan Zhou

To improve the sample efficiency of policy-gradient based reinforcement learning algorithms, we propose implicit distributional actor-critic (IDAC) that consists of a distributional critic, built on two deep generator ne…

Distributional Reinforcement Learning OpenAI Gym reinforcement-learning Reinforcement Learning+1

Implicit Constraint-Aware Off-Policy Correction for Offline Reinforcement Learning

2025-06-16 · Ali Baheri

Offline reinforcement learning promises policy improvement from logged interaction data alone, yet state-of-the-art algorithms remain vulnerable to value over-estimation and to violations of domain knowledge such as mono…

Q-Learning

ISEP: Implicit Support Expansion for Offline Reinforcement Learning via Stochastic Policy Optimization

2026-05-18 · Yifei Chen, Shaoqin Zhu, Xiaoqiang Ji arxiv

Offline reinforcement learning methods typically enforce strict constraints to ensure safety; yet this rigidity often prevents the discovery of optimal behaviors outside the immediate support of the behavior policy. To a…

Reinforcement Learning

Offline Reinforcement Learning with Implicit Q-Learning

2021-10-12 · Ilya Kostrikov, Ashvin Nair, Sergey Levine

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the beha…

D4RL Offline RL Q-Learning reinforcement-learning+2