Model-free tracking control of complex dynamical trajectories with machine learning
Nonlinear tracking control enabling a dynamical system to track a desired trajectory is fundamental to robotics, serving a wide range of civil and defense applications. In control engineering, designing tracking control requires complete knowledge of the system model and equations. We develop a model-free, machine-learning framework to control a two-arm robotic manipulator using only partially observed states, where the controller is realized by reservoir computing. Stochastic input is exploited for training, which consists of the observed partial state vector as the first and its immediate future as the second component so that the neural machine regards the latter as the future state of the former. In the testing (deployment) phase, the immediate-future component is replaced by the desired observational vector from the reference trajectory. We demonstrate the effectiveness of the control framework using a variety of periodic and chaotic signals, and establish its robustness against measurement noise, disturbances, and uncertainties.
Code (1)
Similar Papers 제목 키워드 기반
Nonlinear Model Predictive Control for Trajectory Tracking of Differentially Flat Fixed-Wing Aerial Systems
Planning and control of fixed-wing Unmanned Aerial Vehicles (UAVs) are challenging due to nonlinear dynamics, aerodynamic limits, and environmental disturbances. Differential flatness offers a principled way to generate …
Trajectory Optimization for Unknown Constrained Systems using Reinforcement Learning
In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not …
Motion Planningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Rethinking Reference Trajectories in Agile Drone Racing: A Unified Reference-Free Model-Based Controller via MPPI
While model-based controllers have demonstrated remarkable performance in autonomous drone racing, their performance is often constrained by the reliance on pre-computed reference trajectories. Conventional approaches, s…
Reinforcement LearningAdaptive Dynamic Programming for Model-free Tracking of Trajectories with Time-varying Parameters
In order to autonomously learn to control unknown systems optimally w.r.t. an objective function, Adaptive Dynamic Programming (ADP) is well-suited to adapt controllers based on experience from interaction with the syste…
Model-free LQR based PID controller for trajectory tracking of 2-DoF helicopter: comparison and experimental results
This paper studies the performance of a model-free LQR based PID (i-LQR-PID) controller designed for tracking control problem of a 2-DoF laboratory helicopter. The control problem addressed in 2-DoF helicopter system aim…