paper-with-me

홈 › Papers

A Q-learning approach to the continuous control problem of robot inverted pendulum balancing

2023-12-05 · Mohammad Safeea, Pedro Neto

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical difficulties related to the direct learning on the real robotic system, the learning phase is performed in simulation environment. A mathematical model of the system dynamics is implemented, deduced by curve fitting on data acquired from the real system. The proposed approach demonstrated feasible, featuring its application on a real world robot that learned to balance an inverted pendulum. This study also reinforces and demonstrates the importance of an accurate representation of the physical world in simulation to achieve a more efficient implementation of reinforcement learning algorithms in real world, even when using a discrete action space algorithm to control a continuous action.

📄 PDF Abstract BibTeX arXiv:2312.02649

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-controlContinuous ControlQ-Learningreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Designing and Analyzing the PID and Fuzzy Control System for an Inverted Pendulum

2021-11-09 · Armin Masoumian, Pezhman kazemi, Mohammad Chehreghani Montazer, Hatem A. Rashwan 외

The inverted pendulum is a non-linear unbalanced system that needs to be controlled using motors to achieve stability and equilibrium. The inverted pendulum is constructed with Lego and using the Lego Mindstorm NXT, whic…

The 3D Linear Inverted Pendulum Mode : A simple modeling for a biped walking pattern generation

2001-11-03 · International Conference on Intelligent Robots and Systems 2001 11 · Shuuji Kajita, Fumio Kanehiro, Kenji Kaneko, Kazuhito Yokoiand 외

For 3D walking control of a biped robot we analyse the dynamics of a three dimensional inverted pendulum in which motion is constrained to move along an arbitrarily defined plane. This analysis leads us a simple linear d…

A Comparison of Reward Functions in Q-Learning Applied to a Cart Position Problem

2021-05-25 · Amartya Mukherjee

Growing advancements in reinforcement learning has led to advancements in control theory. Reinforcement learning has effectively solved the inverted pendulum problem and more recently the double inverted pendulum problem…

PositionQ-Learningreinforcement-learningReinforcement Learning+1

Critic PI2: Master Continuous Planning via Policy Improvement with Path Integrals and Deep Actor-Critic Reinforcement Learning

2020-11-13 · Jiajun Fan, He Ba, Xian Guo, Jianye Hao

Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods from AlphaGo to Muzero have enjoyed huge success in discrete …

continuous-controlContinuous ControlModel-based Reinforcement Learningreinforcement-learning+2

Real-time implementation of MPC for tracking in embedded systems: Application to a two-wheeled inverted pendulum

2021-03-26 · Pablo Krupa, Jose Camara, Ignacio Alvarado, Daniel Limon 외

This article presents the real-time implementation of the model predictive control for tracking formulation to control a two-wheeled inverted pendulum robot. This formulation offers several advantages over standard MPC f…

Model Predictive Control