Probabilistic Robust Linear Quadratic Regulators with Gaussian Processes
Probabilistic models such as Gaussian processes (GPs) are powerful tools to learn unknown dynamical systems from data for subsequent use in control design. While learning-based control has the potential to yield superior performance in demanding applications, robustness to uncertainty remains an important challenge. Since Bayesian methods quantify uncertainty of the learning results, it is natural to incorporate these uncertainties into a robust design. In contrast to most state-of-the-art approaches that consider worst-case estimates, we leverage the learning method's posterior distribution in the controller synthesis. The result is a more informed and, thus, more efficient trade-off between performance and robustness. We present a novel controller synthesis for linearized GP dynamics that yields robust controllers with respect to a probabilistic stability margin. The formulation is based on a recently proposed algorithm for linear quadratic control synthesis, which we extend by giving probabilistic robustness guarantees in the form of credibility bounds for the system's stability.Comparisons to existing methods based on worst-case and certainty-equivalence designs reveal superior performance and robustness properties of the proposed method.
Code (1)
Tasks
Gaussian ProcessesRobust DesignSimilar Papers 제목 키워드 기반
Guaranteed Stability Margins for Decentralized Linear Quadratic Regulators
It is well-known that linear quadratic regulators (LQR) enjoy guaranteed stability margins, whereas linear quadratic Gaussian regulators (LQG) do not. In this letter, we consider systems and compensators defined over dir…
Ensemble-Conditional Gaussian Processes (Ens-CGP): Representation, Geometry, and Inference
We formulate Ensemble-Conditional Gaussian Processes (Ens-CGP), a finite-dimensional synthesis that centers ensemble-based inference on the conditional Gaussian law. Conditional Gaussian processes (CGP) arise directly fr…
Gaussian ProcessesSafe Exploration for Nonlinear Processes Using Online Gaussian Process Learning
This paper proposes a safe data-driven control framework for nonlinear systems with partially known dynamics. The method ensures stability and constraint satisfaction during online learning, assuming only a stabilizable …
Linear-Quadratic regulators for internal boundary control of lane-free automated vehicle traffic
Lane-free vehicle movement has been recently proposed for connected automated vehicles (CAV) due to various potential advantages. One such advantage stems from the fact that incremental changes of the road width in lane-…
Sparse Gaussian Processes via Parametric Families of Compactly-supported Kernels
Gaussian processes are powerful models for probabilistic machine learning, but are limited in application by their $O(N^3)$ inference complexity. We propose a method for deriving parametric families of kernel functions w…
Gaussian Processes