Stability Analysis of Optimal Adaptive Control using Value Iteration with Approximation Errors
Adaptive optimal control using value iteration initiated from a stabilizing control policy is theoretically analyzed in terms of stability of the system during the learning stage without ignoring the effects of approximation errors. This analysis includes the system operated using any single/constant resulting control policy and also using an evolving/time-varying control policy. A feature of the presented results is providing estimations of the \textit{region of attraction} so that if the initial condition is within the region, the whole trajectory will remain inside it and hence, the function approximation results remain valid.
Code (0)
등록된 구현이 없습니다.
Tasks
validSimilar Papers 제목 키워드 기반
Exponentially Stable Adaptive Optimal Control of Uncertain LTI Systems
A novel method of an adaptive linear quadratic (LQ) regulation of uncertain continuous linear time-invariant systems is proposed. Such an approach is based on the direct self-tuning regulators design framework and the ex…
Statistical-mechanical analysis of adaptive filter with clipping saturation-type nonlinearity
In most practical adaptive signal processing systems, e.g., active noise control, active vibration control, and acoustic echo cancellation, substantial nonlinearities that cannot be neglected exist. In this paper, we ana…
Acoustic echo cancellationVocal Bursts Type PredictionStabilizing Value Iteration with and without Approximation Errors
Adaptive optimal control using value iteration (VI) initiated from a stabilizing policy is theoretically analyzed in various aspects including the continuity of the result, the stability of the system operated using any …
A note on stabilizing reinforcement learning
Reinforcement learning is a general methodology of adaptive optimal control that has attracted much attention in various fields ranging from video game industry to robot manipulators. Despite its remarkable performance d…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)MR-ARL: Model Reference Adaptive Reinforcement Learning for Robustly Stable On-Policy Data-Driven LQR
This article introduces a novel framework for data-driven linear quadratic regulator (LQR) design. First, we introduce a reinforcement learning paradigm for on-policy data-driven LQR, where exploration and exploitation a…
reinforcement-learningReinforcement Learning