Direct Data-Driven Discrete-time Bilinear Biquadratic Regulator
We present a novel direct data-driven algorithm that learns an optimal control policy for the Bilinear Biquadratic Regulator (BBR) for an unknown bilinear system. The BBR is difficult to solve owing to the presence of the nonlinear biquadratic performance index and the bilinear cross-term in the dynamics. To address these difficulties, we apply several transformations on the state decision variables to obtain a nonlinear optimization problem with a linear performance index and affine (in the parameterized control) state-dependent equality. The adroit use of the Hamiltonian and Pontryagin's Minimum Principle allows us to derive a pair of first-order necessary conditions that, at each point in time, are easily solvable linear matrix equalities (LMEs) which give the optimal state-dependent control law. We then use the marginal sample autocorrelation of the collected data to obtain a direct data-driven equivalent of these LMEs. We demonstrate the performance of the proposed algorithm via illustrative numerical examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningSimilar Papers 제목 키워드 기반
Bilinear Data-Driven Min-Max MPC: Designing Rational Controllers via Sum-of-squares Optimization
We propose a data-driven min-max model predictive control (MPC) scheme to control unknown discrete-time bilinear systems. Based on a sequence of noisy input-state data, we state a set-membership representation for the un…
Model Predictive ControlData-based stabilization of unknown bilinear systems with guaranteed basin of attraction
Motivated by the goal of having a building block in the direct design of data-driven controllers for nonlinear systems, we show how, for an unknown discrete-time bilinear system, the data collected in an offline open-loo…
Data-driven Stabilization of Discrete-time Control-affine Nonlinear Systems: A Koopman Operator Approach
In recent years data-driven analysis of dynamical systems has attracted a lot of attention and transfer operator techniques, namely, Perron-Frobenius and Koopman operators are being used almost ubiquitously. Since data i…
Time SeriesTime Series AnalysisRobust data-driven control for nonlinear systems using the Koopman operator
Data-driven analysis and control of dynamical systems have gained a lot of interest in recent years. While the class of linear systems is well studied, theoretical results for nonlinear systems are still rare. In this pa…
On the Realization of Impulse Invariant Bilinear Volterra Kernels
As previously shown, the direct extension of the impulse invariance principle to Volterra kernels has to be modified in order to provide a condition for the exact modeling of mixed-signal chains. At first sight this woul…