A Q-learning approach to the continuous control problem of robot inverted pendulum balancing
This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical difficulties related to the direct learning on the real robotic system, the learning phase is performed in simulation environment. A mathematical model of the system dynamics is implemented, deduced by curve fitting on data acquired from the real system. The proposed approach demonstrated feasible, featuring its application on a real world robot that learned to balance an inverted pendulum. This study also reinforces and demonstrates the importance of an accurate representation of the physical world in simulation to achieve a more efficient implementation of reinforcement learning algorithms in real world, even when using a discrete action space algorithm to control a continuous action.
Code (0)
등록된 구현이 없습니다.
Tasks
continuous-controlContinuous ControlQ-Learningreinforcement-learningReinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Designing and Analyzing the PID and Fuzzy Control System for an Inverted Pendulum
The inverted pendulum is a non-linear unbalanced system that needs to be controlled using motors to achieve stability and equilibrium. The inverted pendulum is constructed with Lego and using the Lego Mindstorm NXT, whic…
The 3D Linear Inverted Pendulum Mode : A simple modeling for a biped walking pattern generation
For 3D walking control of a biped robot we analyse the dynamics of a three dimensional inverted pendulum in which motion is constrained to move along an arbitrarily defined plane. This analysis leads us a simple linear d…
A Comparison of Reward Functions in Q-Learning Applied to a Cart Position Problem
Growing advancements in reinforcement learning has led to advancements in control theory. Reinforcement learning has effectively solved the inverted pendulum problem and more recently the double inverted pendulum problem…
PositionQ-Learningreinforcement-learningReinforcement Learning+1Critic PI2: Master Continuous Planning via Policy Improvement with Path Integrals and Deep Actor-Critic Reinforcement Learning
Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods from AlphaGo to Muzero have enjoyed huge success in discrete …
continuous-controlContinuous ControlModel-based Reinforcement Learningreinforcement-learning+2Real-time implementation of MPC for tracking in embedded systems: Application to a two-wheeled inverted pendulum
This article presents the real-time implementation of the model predictive control for tracking formulation to control a two-wheeled inverted pendulum robot. This formulation offers several advantages over standard MPC f…
Model Predictive Control