Co-state Neural Network for Real-time Nonlinear Optimal Control with Input Constraints
In this paper, we propose a method to solve nonlinear optimal control problems (OCPs) with constrained control input in real-time using neural networks (NNs). We introduce what we have termed co-state Neural Network (CoNN) that learns the mapping from any given state value to its corresponding optimal co-state trajectory based on the Pontryagin's Minimum (Maximum) Principle (PMP). In essence, the CoNN parameterizes the Two-Point Boundary Value Problem (TPBVP) that results from the PMP for various initial states. The CoNN is trained using data generated from numerical solutions of TPBVPs for unconstrained OCPs to learn the mapping from a state to its corresponding optimal co-state trajectory. For better generalizability, the CoNN is also trained to respect the first-order optimality conditions (system dynamics). The control input constraints are satisfied by solving a quadratic program (QP) given the predicted optimal co-states. We demonstrate the effectiveness of our CoNN-based controller in a feedback scheme for numerical examples with both unconstrained and constrained control input. We also verify that the controller can handle unknown disturbances effectively.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Koopman System Approximation Based Optimal Control of Multiple Robots -- Part II: Simulations and Evaluations
This report presents the results of a simulation study of the linear model and bilinear model approximations of the Koopman system model of the nonlinear utility functions in optimal control of a 3-robot system. In such …
Learning-Based Stable Optimal Control for Infinite-Time Nonlinear Regulation Problems
Infinite-time nonlinear optimal regulation control is widely utilized in aerospace engineering as a systematic method for synthesizing stable controllers. However, conventional methods often rely on linearization hypothe…
Efficient Optimal Path Planning in Dynamic Environments Using Koopman MPC
This paper presents a data-driven model predictive control framework for mobile robots navigating in dynamic environments, leveraging Koopman operator theory. Unlike the conventional Koopman-based approaches that focus o…
Computational EfficiencyCollision AvoidanceDifferentially Flat Learning-based Model Predictive Control Using a Stability, State, and Input Constraining Safety Filter
Learning-based optimal control algorithms control unknown systems using past trajectory data and a learned model of the system dynamics. These controllers use either a linear approximation of the learned dynamics, tradin…
Computational EfficiencyModel Predictive ControlGPU-Parallel Linearization Error Bounds for Real-Time Robust Optimal Control of Nonlinear and Neural Network Dynamics
This paper studies real-time robust optimal control for uncertain nonlinear systems, where linear time-varying (LTV) approximations make planning tractable but require sound linearization error bounds (LEBs) to guarantee…