Learning Stabilizable Nonlinear Dynamics with Contraction-Based Regularization
We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key contribution is a control-theoretic regularizer for dynamics fitting rooted in the notion of stabilizability, a constraint which guarantees the existence of robust tracking controllers for arbitrary open-loop trajectories generated with the learned system. Leveraging tools from contraction theory and statistical learning in Reproducing Kernel Hilbert Spaces, we formulate stabilizable dynamics learning as a functional optimization with convex objective and bi-convex functional constraints. Under a mild structural assumption and relaxation of the functional constraints to sampling-based constraints, we derive the optimal solution with a modified Representer theorem. Finally, we utilize random matrix feature approximations to reduce the dimensionality of the search parameters and formulate an iterative convex optimization algorithm that jointly fits the dynamics functions and searches for a certificate of stabilizability. We validate the proposed algorithm in simulation for a planar quadrotor, and on a quadrotor hardware testbed emulating planar dynamics. We verify, both in simulation and on hardware, significantly improved trajectory generation and tracking performance with the control-theoretic regularized model over models learned using traditional regression techniques, especially when learning from small supervised datasets. The results support the conjecture that the use of stabilizability constraints as a form of regularization can help prune the hypothesis space in a manner that is tailored to the downstream task of trajectory generation and feedback control, resulting in models that are not only dramatically better conditioned, but also data efficient.
Code (1)
Tasks
continuous-controlContinuous ControlSimilar Papers 제목 키워드 기반
Learning Stabilizable Dynamical Systems via Control Contraction Metrics
We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key idea is to develop a new control-theoretic regularizer for dynamics fitting rooted in t…
continuous-controlContinuous ControlModel-based Reinforcement LearningReinforcement LearningRobust contraction-based model predictive control for nonlinear systems
Model Predictive Control (MPC) is a widely known control method that has proved to be particularly effective in multivariable and constrained control. Closed-loop stability and recursive feasibility can be guaranteed by …
Model Predictive ControlModel Error Propagation via Learned Contraction Metrics for Safe Feedback Motion Planning of Unknown Systems
We present a method for contraction-based feedback motion planning of locally incrementally exponentially stabilizable systems with unknown dynamics that provides probabilistic safety and reachability guarantees. Given a…
Deformable Object ManipulationMotion PlanningvalidNeural Contraction Metrics with Formal Guarantees for Discrete-Time Nonlinear Dynamical Systems
Contraction metrics are crucial in control theory because they provide a powerful framework for analyzing stability, robustness, and convergence of various dynamical systems. However, identifying these metrics for comple…
Constrained nonlinear output regulation using model predictive control -- extended version
We present a model predictive control (MPC) framework to solve the constrained nonlinear output regulation problem. The main feature of the proposed framework is that the application does not require the solution to clas…
Model Predictive Control