Proximal Deterministic Policy Gradient

2020-08-03 · Marco Maggipinto, Gian Antonio Susto, Pratik Chaudhari

This paper introduces two simple techniques to improve off-policy Reinforcement Learning (RL) algorithms. First, we formulate off-policy RL as a stochastic proximal point iteration. The target network plays the role of the variable of optimization and the value network computes the proximal operator. Second, we exploits the two value functions commonly employed in state-of-the-art off-policy algorithms to provide an improved action value estimate through bootstrapping with limited increase of computational resources. Further, we demonstrate significant performance improvement over state-of-the-art algorithms on standard continuous-control RL benchmarks.

📄 PDF Abstract BibTeX arXiv:2008.00759

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous Control reinforcement-learning Reinforcement Learning (RL)

Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learning

2023-05-23 · Sumeet Batra, Bryon Tjanaka, Matthew C. Fontaine, Aleksei Petrenko 외

Training generally capable agents that thoroughly explore their environment and learn new and diverse skills is a long-term goal of robot learning. Quality Diversity Reinforcement Learning (QD-RL) is an emerging research…

Diversity reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Controlling an Inverted Pendulum with Policy Gradient Methods-A Tutorial

2021-05-17 · Swagat Kumar

This paper provides the details of implementing two important policy gradient methods to solve the inverted pendulum problem. These are namely the Deep Deterministic Policy Gradient (DDPG) and the Proximal Policy Optimiz…

OpenAI Gym Policy Gradient Methods

Deep Reinforcement Learning for Stock Portfolio Optimization

2020-12-09 · Le Trung Hieu

Stock portfolio optimization is the process of constant re-distribution of money to a pool of various stocks. In this paper, we will formulate the problem such that we can apply Reinforcement Learning for the task proper…

Deep Reinforcement Learning Portfolio Optimization reinforcement-learning Reinforcement Learning+1

Obstacle Avoidance and Navigation Utilizing Reinforcement Learning with Reward Shaping

2020-03-28 · Daniel Zhang, Colleen P. Bailey

In this paper, we investigate the obstacle avoidance and navigation problem in the robotic control area. For solving such a problem, we propose revised Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Proximal Policy Gradient: PPO with Policy Gradient

2020-10-20 · Ju-Seung Byun, Byungmoon Kim, Huamin Wang

In this paper, we propose a new algorithm PPG (Proximal Policy Gradient), which is close to both VPG (vanilla policy gradient) and PPO (proximal policy optimization). The PPG objective is a partial variation of the VPG o…

OpenAI Gym