Joint Learning of Linear Time-Invariant Dynamical Systems
Linear time-invariant systems are very popular models in system theory and applications. A fundamental problem in system identification that remains rather unaddressed in extant literature is to leverage commonalities amongst related linear systems to estimate their transition matrices more accurately. To address this problem, the current paper investigates methods for jointly estimating the transition matrices of multiple systems. It is assumed that the transition matrices are unknown linear functions of some unknown shared basis matrices. We establish finite-time estimation error rates that fully reflect the roles of trajectory lengths, dimension, and number of systems under consideration. The presented results are fairly general and show the significant gains that can be achieved by pooling data across systems in comparison to learning each system individually. Further, they are shown to be robust against model misspecifications. To obtain the results, we develop novel techniques that are of interest for addressing similar joint-learning problems. They include tightly bounding estimation errors in terms of the eigen-structures of transition matrices, establishing sharp high probability bounds for singular values of dependent random matrices, and capturing effects of misspecified transition matrices as the systems evolve over time.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
On the lifting and reconstruction of nonlinear systems with multiple invariant sets
The Koopman operator provides a linear perspective on non-linear dynamics by focusing on the evolution of observables in an invariant subspace. Observables of interest are typically linearly reconstructed from the Koopma…
MisconceptionsCharacterising Linear Spatio-Temporal Dynamical Systems in the Frequency Domain
A new concept, called the spatio-temporal transfer function (STTF), is introduced to characterise a class of linear time-invariant (LTI) spatio-temporal dynamical systems. The spatio-temporal transfer function is a natur…
Koopman Invariants as Drivers of Emergent Time-Series Clustering in Joint-Embedding Predictive Architectures
Joint-Embedding Predictive Architectures (JEPAs), a powerful class of self-supervised models, exhibit an unexplained ability to cluster time-series data by their underlying dynamical regimes. We propose a novel theoretic…
Self-Supervised LearningAn efficient implementation of graph-based invariant set algorithm for constrained nonlinear dynamical systems
The graph-based invariant set (GIS) algorithm is a promising set-based technique for computing the largest (with respect to inclusion) control invariant set of general discrete-time nonlinear dynamical systems. However, …
graph constructionMulti-Task System Identification of Similar Linear Time-Invariant Dynamical Systems
This paper presents a system identification framework -- inspired by multi-task learning -- to estimate the dynamics of a given number of linear time-invariant (LTI) systems jointly by leveraging structural similarities …
Federated LearningMulti-Task Learning