paper-with-me

Papers

Regularized linear system identification using atomic, nuclear and kernel-based norms: the role of the stability constraint

2015-07-02 · Gianluigi Pillonetto, Tianshi Chen, Alessandro Chiuso, Giuseppe De Nicolao, Lennart Ljung

Inspired by ideas taken from the machine learning literature, new regularization techniques have been recently introduced in linear system identification. In particular, all the adopted estimators solve a regularized least squares problem, differing in the nature of the penalty term assigned to the impulse response. Popular choices include atomic and nuclear norms (applied to Hankel matrices) as well as norms induced by the so called stable spline kernels. In this paper, a comparative study of estimators based on these different types of regularizers is reported. Our findings reveal that stable spline kernels outperform approaches based on atomic and nuclear norms since they suitably embed information on impulse response stability and smoothness. This point is illustrated using the Bayesian interpretation of regularization. We also design a new class of regularizers defined by "integral" versions of stable spline/TC kernels. Under quite realistic experimental conditions, the new estimators outperform classical prediction error methods also when the latter are equipped with an oracle for model order selection.

📄 PDF Abstract BibTeX arXiv:1507.00564

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Finite Sample System Identification: Improved Rates and the Role of Regularization

2020-06-08 · L4DC 2020 6 · Yue Sun, Samet Oymak, Maryam Fazel

This paper studies low-order linear system identification via regularized regression. The nuclear norm of the system’s Hankel matrix is added as a regularizer to the least-squares cost function due to the following advan…

Infinite-Dimensional Sparse Learning in Linear System Identification

2022-03-28 · Mingzhou Yin, Mehmet Tolga Akan, Andrea Iannelli, Roy S. Smith

Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. At…

Sparse Learning

System Identification via Nuclear Norm Regularization

2022-03-30 · Yue Sun, Samet Oymak, Maryam Fazel

This paper studies the problem of identifying low-order linear systems via Hankel nuclear norm regularization. Hankel regularization encourages the low-rankness of the Hankel matrix, which maps to the low-orderness of th…

Model Selection

Nonconvex Linear System Identification with Minimal State Representation

2025-04-26 · Uday Kiran Reddy Tadipatri, Benjamin D. Haeffele, Joshua Agterberg, Ingvar Ziemann 외

Low-order linear System IDentification (SysID) addresses the challenge of estimating the parameters of a linear dynamical system from finite samples of observations and control inputs with minimal state representation. T…

Computational Efficiency

Accelerating nuclear-norm regularized low-rank matrix optimization through Burer-Monteiro decomposition

2022-04-29 · Ching-pei Lee, Ling Liang, Tianyun Tang, Kim-Chuan Toh

This work proposes a rapid algorithm, BM-Global, for nuclear-norm-regularized convex and low-rank matrix optimization problems. BM-Global efficiently decreases the objective value via low-cost steps leveraging the noncon…

Recommendation Systems