paper-with-me

홈 › Papers

Robust penalized least squares of depth trimmed residuals regression for high-dimensional data

2023-09-04 · Yijun Zuo

Challenges with data in the big-data era include (i) the dimension $p$ is often larger than the sample size $n$ (ii) outliers or contaminated points are frequently hidden and more difficult to detect. Challenge (i) renders most conventional methods inapplicable. Thus, it attracts tremendous attention from statistics, computer science, and bio-medical communities. Numerous penalized regression methods have been introduced as modern methods for analyzing high-dimensional data. Disproportionate attention has been paid to the challenge (ii) though. Penalized regression methods can do their job very well and are expected to handle the challenge (ii) simultaneously. Most of them, however, can break down by a single outlier (or single adversary contaminated point) as revealed in this article. The latter systematically examines leading penalized regression methods in the literature in terms of their robustness, provides quantitative assessment, and reveals that most of them can break down by a single outlier. Consequently, a novel robust penalized regression method based on the least sum of squares of depth trimmed residuals is proposed and studied carefully. Experiments with simulated and real data reveal that the newly proposed method can outperform some leading competitors in estimation and prediction accuracy in the cases considered.

📄 PDF Abstract BibTeX arXiv:2309.01666

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Computation of Least Trimmed Squares: A Branch-and-Bound framework with Hyperplane Arrangement Enhancements

2026-04-13 · Xiang Meng, Andrés Gómez, Rahul Mazumder arxiv

We study computational aspects of a key problem in robust statistics -- the penalized least trimmed squares (LTS) regression problem, a robust estimator that mitigates the influence of outliers in data by capping residua…

Non-asymptotic analysis of the performance of the penalized least trimmed squares in sparse models

2025-01-09 · Yijun Zuo

The least trimmed squares (LTS) estimator is a renowned robust alternative to the classic least squares estimator and is popular in location, regression, machine learning, and AI literature. Many studies exist on LTS, in…

Attributeregression

Coordinate Descent for MCP/SCAD Penalized Least Squares Converges Linearly

2021-09-18 · Yuling Jiao, Dingwei Li, Min Liu, Xiliang Lu

Recovering sparse signals from observed data is an important topic in signal/imaging processing, statistics and machine learning. Nonconvex penalized least squares have been attracted a lot of attentions since they enjoy…

Cross validation residuals for generalised least squares and other correlated data models

2018-09-05 · Ingrid Annette Baade

Cross validation residuals are well known for the ordinary least squares model. Here leave-M-out cross validation is extended to generalised least squares. The relationship between cross validation residuals and Cook's d…

All

Local Polynomial Lp-norm Regression

2025-04-25 · Ladan Tazik, James Stafford, John Braun

The local least squares estimator for a regression curve cannot provide optimal results when non-Gaussian noise is present. Both theoretical and empirical evidence suggests that residuals often exhibit distributional pro…

regression