Range Space or Null Space: Least-Squares Methods for the Realization Problem
This contribution revisits the classical approximate realization problem, which involves determining matrices of a state-space model based on estimates of a truncated series of Markov parameters. A Hankel matrix built up by these Markov parameters plays a fundamental role in this problem, leveraging the fact that both its range space and left null space encode critical information about the state-space model. We examine two prototype realization algorithms based on the Hankel matrix: the classical range-space-based (SVD-based) method and the more recent null-space-based method. It is demonstrated that the range-space-based method corresponds to a total least-squares solution, whereas the null-space-based method corresponds to an ordinary least-squares solution. By analyzing the differences in sensitivity of the two algorithms, we determine the conditions when one or the other realization algorithm is to be preferred, and identify factors that contribute to an ill-conditioned realization problem. Furthermore, recognizing that both methods are suboptimal, we argue that the optimal realization is obtained through a weighted least-squares approach. A statistical analysis of these methods, including their consistency and asymptotic normality is also provided.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Weighted Null Space Fitting (WNSF): A Link between The Prediction Error Method and Subspace Identification
Subspace identification method (SIM) has been proven to be very useful and numerically robust for estimating state-space models. However, it is in general not believed to be as accurate as the prediction error method (PE…
State Space ModelsA Weighted Least-Squares Method for Non-Asymptotic Identification of Markov Parameters from Multiple Trajectories
Markov parameters play a key role in system identification. There exists many algorithms where these parameters are estimated using least-squares in a first, pre-processing, step, including subspace identification and mu…
Exact Constraint Enforcement in Physics-Informed Extreme Learning Machines using Null-Space Projection Framework
Physics-informed extreme learning machines (PIELMs) typically impose boundary and initial conditions through penalty terms, yielding only approximate satisfaction that is sensitive to user-specified weights and can propa…
Weighted Least-Squares PARSIM
Subspace identification methods (SIMs) have proven very powerful for estimating linear state-space models. To overcome the deficiencies of classical SIMs, a significant number of algorithms has appeared over the last two…
State Space ModelsA Risk Comparison of Ordinary Least Squares vs Ridge Regression
We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a Principal Component Analysis) and then pe…
regression