paper-with-me

Papers

Statistical inference for high dimensional regression via Constrained Lasso

2017-04-17 · Yun Yang

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by simultaneously solving two estimating equations---one imposing a zero-bias constraint for the low-dimensional parameter and the other forming an $\ell_1$-penalized procedure for the high-dimensional nuisance parameter. By carefully choosing the zero-bias constraint, the resulting estimator of the low dimensional parameter is shown to admit an asymptotically normal limit attaining the Cram\'{e}r-Rao lower bound in a semiparametric sense. We propose a tuning-free iterative algorithm for implementing the CLasso. We show that when the algorithm is initialized at the Lasso estimator, the de-sparsified estimator proposed in van de Geer et al. [\emph{Ann. Statist.} {\bf 42} (2014) 1166--1202] is asymptotically equivalent to the first iterate of the algorithm. We analyse the asymptotic properties of the CLasso estimator and show the globally linear convergence of the algorithm. We also demonstrate encouraging empirical performance of the CLasso through numerical studies.

📄 PDF Abstract BibTeX arXiv:1704.05098

Code (0)

등록된 구현이 없습니다.

Tasks

regressionVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

High Dimensional Time Series Regression Models: Applications to Statistical Learning Methods

2023-08-27 · Christis Katsouris

These lecture notes provide an overview of existing methodologies and recent developments for estimation and inference with high dimensional time series regression models. First, we present main limit theory results for …

regressionTime SeriesTime Series AnalysisTime Series Regression

Post-Transfer Learning Statistical Inference in High-Dimensional Regression

2025-04-25 · Nguyen Vu Khai Tam, Cao Huyen My, Vo Nguyen Le Duy

Transfer learning (TL) for high-dimensional regression (HDR) is an important problem in machine learning, particularly when dealing with limited sample size in the target task. However, there currently lacks a method to …

feature selectionregressionTransfer Learningvalid

Dirty Statistical Models

2013-12-01 · NeurIPS 2013 12 · Eunho Yang, Pradeep K. Ravikumar

We provide a unified framework for the high-dimensional analysis of “superposition-structured” or “dirty” statistical models: where the model parameters are a “superposition” of structurally constrained parameters. We al…

regression

BART: Bayesian additive regression trees

2008-06-19 · Hugh A. Chipman, Edward I. George, Robert E. McCulloch

We develop a Bayesian "sum-of-trees" model where each tree is constrained by a regularization prior to be a weak learner, and fitting and inference are accomplished via an iterative Bayesian backfitting MCMC algorithm th…

Causal InferenceDrug DiscoveryregressionVariable Selection

Statistical Inference for Low-Rank Tensor Models

2025-01-27 · Ke Xu, Elynn Chen, Yuefeng Han

Statistical inference for tensors has emerged as a critical challenge in analyzing high-dimensional data in modern data science. This paper introduces a unified framework for inferring general and low-Tucker-rank linear …

regression