paper-with-me

홈 › Papers

Outlier-robust estimation of a sparse linear model using $\ell_1$-penalized Huber's $M$-estimator

2019-04-12 · Arnak S. Dalalyan, Philip Thompson

We study the problem of estimating a $p$-dimensional $s$-sparse vector in a linear model with Gaussian design and additive noise. In the case where the labels are contaminated by at most $o$ adversarial outliers, we prove that the $\ell_1$-penalized Huber's $M$-estimator based on $n$ samples attains the optimal rate of convergence $(s/n)^{1/2} + (o/n)$, up to a logarithmic factor. For more general design matrices, our results highlight the importance of two properties: the transfer principle and the incoherence property. These properties with suitable constants are shown to yield the optimal rates, up to log-factors, of robust estimation with adversarial contamination.

📄 PDF Abstract BibTeX arXiv:1904.06288

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Outlier-robust estimation of a sparse linear model using \ell_1-penalized Huber's M-estimator

2019-12-01 · NeurIPS 2019 12 · Arnak Dalalyan, Philip Thompson

We study the problem of estimating a $p$-dimensional $s$-sparse vector in a linear model with Gaussian design. In the case where the labels are contaminated by at most $o$ adversarial outliers, we prove that the $\ell…

Estimation of sparse linear regression coefficients under $L$-subexponential covariates

2023-04-24 · Takeyuki Sasai

We tackle estimating sparse coefficients in a linear regression when the covariates are sampled from an $L$-subexponential random vector. This vector belongs to a class of distributions that exhibit heavier tails than Ga…

regression

Robustness in sparse linear models: relative efficiency based on robust approximate message passing

2015-07-31 · Jelena Bradic

Understanding efficiency in high dimensional linear models is a longstanding problem of interest. Classical work with smaller dimensional problems dating back to Huber and Bickel has illustrated the benefits of efficient…

Model Selection

MM for Penalized Estimation

2019-12-23 · Zhu Wang

Penalized estimation can conduct variable selection and parameter estimation simultaneously. The general framework is to minimize a loss function subject to a penalty designed to generate sparse variable selection. The m…

parameter estimationVariable Selection

Scale calibration for high-dimensional robust regression

2018-11-06 · Po-Ling Loh

We present a new method for high-dimensional linear regression when a scale parameter of the additive errors is unknown. The proposed estimator is based on a penalized Huber $M$-estimator, for which theoretical results o…

regressionVocal Bursts Intensity Prediction