paper-with-me

홈 › Papers

Sample Complexity of the Sign-Perturbed Sums Identification Method: Scalar Case

2024-01-28 · Szabolcs Szentpéteri, Balázs Csanád Csáji

Sign-Perturbed Sum (SPS) is a powerful finite-sample system identification algorithm which can construct confidence regions for the true data generating system with exact coverage probabilities, for any finite sample size. SPS was developed in a series of papers and it has a wide range of applications, from general linear systems, even in a closed-loop setup, to nonlinear and nonparametric approaches. Although several theoretical properties of SPS were proven in the literature, the sample complexity of the method was not analysed so far. This paper aims to fill this gap and provides the first results on the sample complexity of SPS. Here, we focus on scalar linear regression problems, that is we study the behaviour of SPS confidence intervals. We provide high probability upper bounds, under three different sets of assumptions, showing that the sizes of SPS confidence intervals shrink at a geometric rate around the true parameter, if the observation noises are subgaussian. We also show that similar bounds hold for the previously proposed outer approximation of the confidence region. Finally, we present simulation experiments comparing the theoretical and the empirical convergence rates.

📄 PDF Abstract BibTeX arXiv:2401.15792

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPS 설명 없음
Focus 설명 없음
Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Sample Complexity of the Sign-Perturbed Sums Method

2024-09-02 · Szabolcs Szentpéteri, Balázs Csanád Csáji

We study the sample complexity of the Sign-Perturbed Sums (SPS) method, which constructs exact, non-asymptotic confidence regions for the true system parameters under mild statistical assumptions, such as independent and…

regression

Finite-Sample Identification of Linear Regression Models with Residual-Permuted Sums

2024-06-08 · Szabolcs Szentpéteri, Balázs Csanád Csáji

This letter studies a distribution-free, finite-sample data perturbation (DP) method, the Residual-Permuted Sums (RPS), which is an alternative of the Sign-Perturbed Sums (SPS) algorithm, to construct confidence regions.…

regression

Sign-Perturbed Sums: A New System Identification Approach for Constructing Exact Non-Asymptotic Confidence Regions in Linear Regression Models

2018-07-22 · Balázs Cs. Csáji, Marco C. Campi, Erik Weyer

We propose a new system identification method, called Sign-Perturbed Sums (SPS), for constructing non-asymptotic confidence regions under mild statistical assumptions. SPS is introduced for linear regression models, incl…

Signed-Perturbed Sums Estimation of ARX Systems: Exact Coverage and Strong Consistency (Extended Version)

2024-02-18 · Algo Carè, Erik Weyer, Balázs Cs. Csáji, Marco C. Campi

Sign-Perturbed Sums (SPS) is a system identification method that constructs confidence regions for the unknown system parameters. In this paper, we study SPS for ARX systems, and establish that the confidence regions are…

Non-Asymptotic State-Space Identification of Closed-Loop Stochastic Linear Systems using Instrumental Variables

2023-01-29 · Szabolcs Szentpéteri, Balázs Csanád Csáji

The paper suggests a generalization of the Sign-Perturbed Sums (SPS) finite sample system identification method for the identification of closed-loop observable stochastic linear systems in state-space form. The solution…