Computationally Efficient Robust Estimation of Sparse Functionals
Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and possibly exceed the sample size. We consider the problem of robust estimation of sparse functionals, and provide a computationally and statistically efficient algorithm in the high-dimensional setting. Our theory identifies a unified set of deterministic conditions under which our algorithm guarantees accurate recovery. By further establishing that these deterministic conditions hold with high-probability for a wide range of statistical models, our theory applies to many problems of considerable interest including sparse mean and covariance estimation; sparse linear regression; and sparse generalized linear models.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionSimilar Papers 제목 키워드 기반
Piece-wise quadratic approximations of arbitrary error functions for fast and robust machine learning
Most of machine learning approaches have stemmed from the application of minimizing the mean squared distance principle, based on the computationally efficient quadratic optimization methods. However, when faced with hig…
BIG-bench Machine LearningregressionRieszBoost: Gradient Boosting for Riesz Regression
Answering causal questions often involves estimating linear functionals of conditional expectations, such as the average treatment effect or the effect of a longitudinal modified treatment policy. By the Riesz representa…
FormregressionLearning Causal Effects via Weighted Empirical Risk Minimization
Learning causal effects from data is a fundamental problem across the sciences. Determining the identifiability of a target effect from a combination of the observational distribution and the causal graph underlying a ph…
Causal IdentificationCausal InferenceCoarsening Bias from Variable Discretization in Causal Functionals
Causal identification functionals often require integration over conditional densities of continuous variables, such as those arising in nonparametric identification theory of total and mediated causal effects in DAGs wi…
Deep Neural Network for Phonon-Assisted Optical Spectra in Semiconductors
Ab initio based accurate simulation of phonon-assisted optical spectra of semiconductors at finite temperatures remains a formidable challenge, as it requires large supercells for phonon sampling and computationally expe…
Band Gap