paper-with-me

홈 › Papers

Exact Post Model Selection Inference for Marginal Screening

2014-02-23 · NeurIPS 2014 12 · Jason D. Lee, Jonathan E. Taylor

We develop a framework for post model selection inference, via marginal screening, in linear regression. At the core of this framework is a result that characterizes the exact distribution of linear functions of the response $y$, conditional on the model being selected (``condition on selection" framework). This allows us to construct valid confidence intervals and hypothesis tests for regression coefficients that account for the selection procedure. In contrast to recent work in high-dimensional statistics, our results are exact (non-asymptotic) and require no eigenvalue-like assumptions on the design matrix $X$. Furthermore, the computational cost of marginal regression, constructing confidence intervals and hypothesis testing is negligible compared to the cost of linear regression, thus making our methods particularly suitable for extremely large datasets. Although we focus on marginal screening to illustrate the applicability of the condition on selection framework, this framework is much more broadly applicable. We show how to apply the proposed framework to several other selection procedures including orthogonal matching pursuit, non-negative least squares, and marginal screening+Lasso.

📄 PDF Abstract BibTeX arXiv:1402.5596

Code (0)

등록된 구현이 없습니다.

Tasks

Model SelectionregressionTwo-sample testingvalid

Similar Papers 제목 키워드 기반

ExSIS: Extended Sure Independence Screening for Ultrahigh-dimensional Linear Models

2017-08-21 · Talal Ahmed, Waheed U. Bajwa

Statistical inference can be computationally prohibitive in ultrahigh-dimensional linear models. Correlation-based variable screening, in which one leverages marginal correlations for removal of irrelevant variables from…

An Efficient Post-Selection Inference on High-Order Interaction Models

2015-06-26 · S. Suzumura, K. Nakagawa, K. Tsuda, I. Takeuchi

Finding statistically significant high-order interaction features in predictive modeling is important but challenging task. The difficulty lies in the fact that, for a recent applications with high-dimensional covariates…

Vocal Bursts Intensity Prediction

Ignorance Is Bliss: The Screening Effect of (Noisy) Information

2023-02-22 · Felix Zhiyu Feng, Wenyu Wang, Yufeng Wu, Gaoqing Zhang

This paper studies the value of a firm's internal information when the firm faces an adverse selection problem arising from unobservable managerial abilities. While more precise information allows the firm to make ex pos…

Solving high-dimensional parameter inference: marginal posterior densities & Moment Networks

2020-11-11 · Niall Jeffrey, Benjamin D. Wandelt

High-dimensional probability density estimation for inference suffers from the "curse of dimensionality". For many physical inference problems, the full posterior distribution is unwieldy and seldom used in practice. Ins…

Density EstimationTime SeriesTime Series AnalysisVocal Bursts Intensity Prediction

Nonparametric Variable Screening with Optimal Decision Stumps

2020-11-05 · Jason M. Klusowski, Peter M. Tian

Decision trees and their ensembles are endowed with a rich set of diagnostic tools for ranking and screening variables in a predictive model. Despite the widespread use of tree based variable importance measures, pinning…

DiagnosticModel SelectionVariable Selection