paper-with-me

Papers

Robust Variable Selection and Estimation Via Adaptive Elastic Net S-Estimators for Linear Regression

2021-07-07 · David Kepplinger

Heavy-tailed error distributions and predictors with anomalous values are ubiquitous in high-dimensional regression problems and can seriously jeopardize the validity of statistical analyses if not properly addressed. For more reliable estimation under these adverse conditions, we propose a new robust regularized estimator for simultaneous variable selection and coefficient estimation. This estimator, called adaptive PENSE, possesses the oracle property without prior knowledge of the scale of the residuals and without any moment conditions on the error distribution. The proposed estimator gives reliable results even under very heavy-tailed error distributions and aberrant contamination in the predictors or residuals. Importantly, even in these challenging settings variable selection by adaptive PENSE remains stable. Numerical studies on simulated and real data sets highlight superior finite-sample performance in a vast range of settings compared to other robust regularized estimators in the case of contaminated samples and competitiveness compared to classical regularized estimators in clean samples.

📄 PDF Abstract BibTeX arXiv:2107.03325

Code (1)

dakep/adapense-paper-numerical-studies 공식 구현

Tasks

regressionVariable Selection

Similar Papers 제목 키워드 기반

Variable Selection and Regularization via Arbitrary Rectangle-range Generalized Elastic Net

2021-12-14 · Yujia Ding, Qidi Peng, Zhengming Song, Hansen Chen

We introduce the arbitrary rectangle-range generalized elastic net penalty method, abbreviated to ARGEN, for performing constrained variable selection and regularization in high-dimensional sparse linear models. As a nat…

Variable Selection

Sparse Learning and Class Probability Estimation with Weighted Support Vector Machines

2023-12-17 · Liyun Zeng, Hao Helen Zhang

Classification and probability estimation have broad applications in modern machine learning and data science applications, including biology, medicine, engineering, and computer science. The recent development of a clas…

Ensemble LearningSparse LearningVariable Selection

Adaptive Estimation and Uniform Confidence Bands for Nonparametric Structural Functions and Elasticities

2021-07-25 · Xiaohong Chen, Timothy Christensen, Sid Kankanala

We introduce two data-driven procedures for optimal estimation and inference in nonparametric models using instrumental variables. The first is a data-driven choice of sieve dimension for a popular class of sieve two-sta…

Fast marginal likelihood estimation of penalties for group-adaptive elastic net

2021-01-11 · Mirrelijn M. van Nee, Tim van de Brug, Mark A. van de Wiel

Nowadays, clinical research routinely uses omics data, such as gene expression, for predicting clinical outcomes or selecting markers. Additionally, so-called co-data are often available, providing complementary informat…

Robust Ultra-High-Dimensional Variable Selection With Correlated Structure Using Group Testing

2026-02-06 · Wanru Guo, Juan Xie, Binbin Wang, Weicong Chen 외 arxiv

Background: High-dimensional genomic data exhibit strong group correlation structures that challenge conventional feature selection methods, which often assume feature independence or rely on pre-defined pathways and are…