Experimental Study on Reinforcement Learning-based Control of an Acrobot
We present computational and experimental results on how artificial intelligence (AI) learns to control an Acrobot using reinforcement learning (RL). Thereby the experimental setup is designed as an embedded system, which is of interest for robotics and energy harvesting applications. Specifically, we study the control of angular velocity of the Acrobot, as well as control of its total energy, which is the sum of the kinetic and the potential energy. By this means the RL algorithm is designed to drive the angular velocity or the energy of the first pendulum of the Acrobot towards a desired value. With this, libration or full rotation of the unactuated pendulum of the Acrobot is achieved. Moreover, investigations of the Acrobot control are carried out, which lead to insights about the influence of the state space discretization, the episode length, the action space or the mass of the driven pendulum on the RL control. By further numerous simulations and experiments the effects of parameter variations are evaluated.
Code (0)
등록된 구현이 없습니다.
Tasks
Acrobotreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Solving the swing-up and balance task for the Acrobot and Pendubot with SAC
We present a solution of the swing-up and balance task for the pendubot and acrobot for the participation in the AI Olympics competition at IJCAI 2023. Our solution is based on the Soft Actor Crtic (SAC) reinforcement le…
AcrobotPositionreinforcement-learningReinforcement Learning (RL)Average-Reward Maximum Entropy Reinforcement Learning for Underactuated Double Pendulum Tasks
This report presents a solution for the swing-up and stabilisation tasks of the acrobot and the pendubot, developed for the AI Olympics competition at IROS 2024. Our approach employs the Average-Reward Entropy Advantage …
AcrobotReinforcement Learning (RL)The guide and the explorer: smart agents for resource-limited iterated batch reinforcement learning
Iterated batch reinforcement learning (RL) is a growing subfield fueled by the demand from systems engineers for intelligent control solutions that they can apply within their technical and organizational constraints. Mo…
AcrobotModel Predictive ControlReinforcement Learning (RL)Model-based micro-data reinforcement learning: what are the crucial model properties and which model to choose?
We contribute to micro-data model-based reinforcement learning (MBRL) by rigorously comparing popular generative models using a fixed (random shooting) control agent. We find that on an environment that requires multimod…
AcrobotmodelModel-based Reinforcement LearningAcrobotics: A Generalist Approach to Quadrupedal Robots' Parkour
Climbing, crouching, bridging gaps, and walking up stairs are just a few of the advantages that quadruped robots have over wheeled robots, making them more suitable for navigating rough and unstructured terrain. However,…
Reinforcement Learning