Block Variable Selection in Multivariate Regression and High-dimensional Causal Inference
We consider multivariate regression problems involving high-dimensional predictor and response spaces. To efficiently address such problems, we propose a variable selection method, Multivariate Group Orthogonal Matching Pursuit, which extends the standard Orthogonal Matching Pursuit technique to account for arbitrary sparsity patterns induced by domain-specific groupings over both input and output variables, while also taking advantage of the correlation that may exist between the multiple outputs. We illustrate the utility of this framework for inferring causal relationships over a collection of high-dimensional time series variables. When applied to time-evolving social media content, our models yield a new family of causality-based influence measures that may be seen as an alternative to PageRank. Theoretical guarantees, extensive simulations and empirical studies confirm the generality and value of our framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferenceregressionTime SeriesTime Series AnalysisVariable SelectionVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Local-Polynomial Estimation for Multivariate Regression Discontinuity Designs
We introduce a multivariate local-linear estimator for multivariate regression discontinuity designs in which treatment is assigned by crossing a boundary in the space of running variables. The dominant approach uses the…
regressionvalidVariable Selection Methods for Multivariate, Functional, and Complex Biomedical Data in the AI Age
Many problems within personalized medicine and digital health rely on the analysis of continuous-time functional biomarkers and other complex data structures emerging from high-resolution patient monitoring. In this cont…
Additive modelsregressionVariable SelectionOn the Use of Minimum Penalties in Statistical Learning
Modern multivariate machine learning and statistical methodologies estimate parameters of interest while leveraging prior knowledge of the association between outcome variables. The methods that do allow for estimation o…
Model SelectionregressionA least distance estimator for a multivariate regression model using deep neural networks
We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure…
regressionVariable SelectionMultivariate Dyadic Regression Trees for Sparse Learning Problems
We propose a new nonparametric learning method based on multivariate dyadic regression trees (MDRTs). Unlike traditional dyadic decision trees (DDTs) or classification and regression trees (CARTs), MDRTs are constructed…
General ClassificationregressionSparse LearningVariable Selection