Controlling an Inverted Pendulum with Policy Gradient Methods-A Tutorial
This paper provides the details of implementing two important policy gradient methods to solve the inverted pendulum problem. These are namely the Deep Deterministic Policy Gradient (DDPG) and the Proximal Policy Optimization (PPO) algorithm. The problem is solved by using an actor-critic model where an actor-network is used to learn the policy function and a critic network is to evaluate the actor-network by learning to estimate the Q function. Apart from briefly explaining the mathematics behind these two algorithms, the details of python implementation are provided which helps in demystifying the underlying complexity of the algorithm. In the process, the readers will be introduced to OpenAI/Gym, Tensorflow 2.x and Keras utilities used for implementing the above concepts.
Code (0)
등록된 구현이 없습니다.
Tasks
OpenAI GymPolicy Gradient MethodsSimilar Papers 제목 키워드 기반
A Hybrid Approach for Reinforcement Learning Using Virtual Policy Gradient for Balancing an Inverted Pendulum
Using the policy gradient algorithm, we train a single-hidden-layer neural network to balance a physically accurate simulation of a single inverted pendulum. The trained weights and biases can then be transferred to a ph…
reinforcement-learningReinforcement Learning (RL)Real-time implementation of MPC for tracking in embedded systems: Application to a two-wheeled inverted pendulum
This article presents the real-time implementation of the model predictive control for tracking formulation to control a two-wheeled inverted pendulum robot. This formulation offers several advantages over standard MPC f…
Model Predictive ControlSample Complexity of Estimating the Policy Gradient for Nearly Deterministic Dynamical Systems
Reinforcement learning is a promising approach to learning robotics controllers. It has recently been shown that algorithms based on finite-difference estimates of the policy gradient are competitive with algorithms base…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Biologically Plausible Variational Policy Gradient with Spiking Recurrent Winner-Take-All Networks
One stream of reinforcement learning research is exploring biologically plausible models and algorithms to simulate biological intelligence and fit neuromorphic hardware. Among them, reward-modulated spike-timing-depende…
AllReinforcement Learning (RL)Designing and Analyzing the PID and Fuzzy Control System for an Inverted Pendulum
The inverted pendulum is a non-linear unbalanced system that needs to be controlled using motors to achieve stability and equilibrium. The inverted pendulum is constructed with Lego and using the Lego Mindstorm NXT, whic…