Universal Learning of Nonlinear Dynamics
We study the fundamental problem of learning a marginally stable unknown nonlinear dynamical system. We describe an algorithm for this problem, based on the technique of spectral filtering, which learns a mapping from past observations to the next based on a spectral representation of the system. Using techniques from online convex optimization, we prove vanishing prediction error for any nonlinear dynamical system that has finitely many marginally stable modes, with rates governed by a novel quantitative control-theoretic notion of learnability. The main technical component of our method is a new spectral filtering algorithm for linear dynamical systems, which incorporates past observations and applies to general noisy and marginally stable systems. This significantly generalizes the original spectral filtering algorithm to both asymmetric dynamics as well as incorporating noise correction, and is of independent interest.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Recovering complex ecological dynamics from time series using state-space universal dynamic equations
Ecological systems often exhibit complex nonlinear dynamics like oscillations, chaos, and regime shifts. Universal dynamic equations have shown promise in modeling complex dynamics by combining known functional forms wit…
Time SeriesCoarse-Grained Nonlinear System Identification
We introduce Coarse-Grained Nonlinear Dynamics, an efficient and universal parameterization of nonlinear system dynamics based on the Volterra series expansion. These models require a number of parameters only quasilinea…
Data-driven Reconstruction of Nonlinear Dynamics from Sparse Observation
We present a data-driven model to reconstruct nonlinear dynamics from a very sparse times series data, which relies on the strength of the echo state network (ESN) in learning nonlinear representation of data. With an as…
Transfer learning for nonlinear dynamics and its application to fluid turbulence
We introduce transfer learning for nonlinear dynamics, which enables efficient predictions of chaotic dynamics by utilizing a small amount of data. For the Lorenz chaos, by optimizing the transfer rate, we accomplish mor…
Transfer LearningUniversal Learning of Stochastic Dynamics for Exact Belief Propagation using Bernstein Normalizing Flows
Predicting the distribution of future states in a stochastic system, known as belief propagation, is fundamental to reasoning under uncertainty. However, nonlinear dynamics often make analytical belief propagation intrac…
Density Estimation