Learning-Based Adaptive Optimal Control of Linear Time-Delay Systems: A Policy Iteration Approach
This paper studies the adaptive optimal control problem for a class of linear time-delay systems described by delay differential equations (DDEs). A crucial strategy is to take advantage of recent developments in reinforcement learning and adaptive dynamic programming and develop novel methods to learn adaptive optimal controllers from finite samples of input and state data. In this paper, the data-driven policy iteration (PI) is proposed to solve the infinite-dimensional algebraic Riccati equation (ARE) iteratively in the absence of exact model knowledge. Interestingly, the proposed recursive PI algorithm is new in the present context of continuous-time time-delay systems, even when the model knowledge is assumed known. The efficacy of the proposed learning-based control methods is validated by means of practical applications arising from metal cutting and autonomous driving.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Safe Delay-Adaptive Control of Strict-Feedback Nonlinear Systems with Application in Vehicle Platooning
This paper presents a safe delay-adaptive control for a strict-feedback nonlinear ODE with a delayed actuator, whose dynamic is also a strict-feedback nonlinear ODE and the delay length is unknown. By formulating the del…
Virtual Contraction Approach to Decentralized Adaptive Stabilization of Nonlinear Time-Delayed Networks
In this paper, we utilize a diagonally dominant structure for the decentralized stabilization of unknown nonlinear time-delayed networks. Generalizing the idea of virtual contraction analysis to time-delayed systems, we …
Extending iLQR method with control delay
Iterative linear quadradic regulator(iLQR) has become a benchmark method to deal with nonlinear stochastic optimal control problem. However, it does not apply to delay system. In this paper, we extend the iLQR theory and…
BIG-bench Machine LearningComparison of artificial neural network adaptive control techniques for a nonlinear system with delay
This research paper compares two neural-network-based adaptive controllers, namely the Hybrid Deep Learning Neural Network Controller (HDLNNC) and the Adaptive Model Predictive Control with Nonlinear Prediction and Linea…
Model Predictive ControlObjectAn Adaptive Pilot Model with Reaction Time-Delay
Practical adaptive control implementations where human pilots coexist in the loop are still uncommon, despite their success in handling uncertain dynamical systems. This is owing to their special nonlinear characteristic…
model