High-Dimensional Screening Using Multiple Grouping of Variables
Screening is the problem of finding a superset of the set of non-zero entries in an unknown p-dimensional vector \beta* given n noisy observations. Naturally, we want this superset to be as small as possible. We propose a novel framework for screening, which we refer to as Multiple Grouping (MuG), that groups variables, performs variable selection over the groups, and repeats this process multiple number of times to estimate a sequence of sets that contains the non-zero entries in \beta*. Screening is done by taking an intersection of all these estimated sets. The MuG framework can be used in conjunction with any group based variable selection algorithm. In the high-dimensional setting, where p >> n, we show that when MuG is used with the group Lasso estimator, screening can be consistently performed without using any tuning parameter. Our numerical simulations clearly show the merits of using the MuG framework in practice.
Code (0)
등록된 구현이 없습니다.
Tasks
Variable SelectionVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
High-dimensional Ordinary Least-squares Projection for Screening Variables
Variable selection is a challenging issue in statistical applications when the number of predictors $p$ far exceeds the number of observations $n$. In this ultra-high dimensional setting, the sure independence screening …
Variable SelectionVocal Bursts Intensity PredictionRaSE: A Variable Screening Framework via Random Subspace Ensembles
Variable screening methods have been shown to be effective in dimension reduction under the ultra-high dimensional setting. Most existing screening methods are designed to rank the predictors according to their individua…
Dimensionality ReductionTwo-stage Sampling, Prediction and Adaptive Regression via Correlation Screening (SPARCS)
This paper proposes a general adaptive procedure for budget-limited predictor design in high dimensions called two-stage Sampling, Prediction and Adaptive Regression via Correlation Screening (SPARCS). SPARCS can be appl…
PrognosisregressionVocal Bursts Valence PredictionOn the consistency theory of high dimensional variable screening
Variable screening is a fast dimension reduction technique for assisting high dimensional feature selection. As a preselection method, it selects a moderate size subset of candidate variables for further refining via fea…
Computational EfficiencyDimensionality Reductionfeature selectionVocal Bursts Intensity PredictionExSIS: Extended Sure Independence Screening for Ultrahigh-dimensional Linear Models
Statistical inference can be computationally prohibitive in ultrahigh-dimensional linear models. Correlation-based variable screening, in which one leverages marginal correlations for removal of irrelevant variables from…