paper-with-me

홈 › Papers

A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Models

2014-12-30 · Yang Ning, Han Liu

We consider the problem of uncertainty assessment for low dimensional components in high dimensional models. Specifically, we propose a decorrelated score function to handle the impact of high dimensional nuisance parameters. We consider both hypothesis tests and confidence regions for generic penalized M-estimators. Unlike most existing inferential methods which are tailored for individual models, our approach provides a general framework for high dimensional inference and is applicable to a wide range of applications. From the testing perspective, we develop general theorems to characterize the limiting distributions of the decorrelated score test statistic under both null hypothesis and local alternatives. These results provide asymptotic guarantees on the type I errors and local powers of the proposed test. Furthermore, we show that the decorrelated score function can be used to construct point and confidence region estimators that are semiparametrically efficient. We also generalize this framework to broaden its applications. First, we extend it to handle high dimensional null hypothesis, where the number of parameters of interest can increase exponentially fast with the sample size. Second, we establish the theory for model misspecification. Third, we go beyond the likelihood framework, by introducing the generalized score test based on general loss functions. Thorough numerical studies are conducted to back up the developed theoretical results.

📄 PDF Abstract BibTeX arXiv:1412.8765

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Confidence Sets and Hypothesis Testing in a Likelihood-Free Inference Setting

2020-02-24 · ICML 2020 1 · Niccolò Dalmasso, Rafael Izbicki, Ann B. Lee

Parameter estimation, statistical tests and confidence sets are the cornerstones of classical statistics that allow scientists to make inferences about the underlying process that generated the observed data. A key quest…

parameter estimationTwo-sample testing

Permutation Tests at Nonparametric Rates

2021-02-26 · Marinho Bertanha, EunYi Chung

Classical two-sample permutation tests for equality of distributions have exact size in finite samples, but they fail to control size for testing equality of parameters that summarize each distribution. This paper propos…

Simulator-Based Inference with Waldo: Confidence Regions by Leveraging Prediction Algorithms and Posterior Estimators for Inverse Problems

2022-05-31 · Luca Masserano, Tommaso Dorigo, Rafael Izbicki, Mikael Kuusela 외

Prediction algorithms, such as deep neural networks (DNNs), are used in many domain sciences to directly estimate internal parameters of interest in simulator-based models, especially in settings where the observations i…

PredictionUncertainty Quantificationvalid

Communication-Efficient Distributed Estimation and Inference for Cox's Model

2023-02-23 · Pierre Bayle, Jianqing Fan, Zhipeng Lou

Motivated by multi-center biomedical studies that cannot share individual data due to privacy and ownership concerns, we develop communication-efficient iterative distributed algorithms for estimation and inference in th…

valid

Switching Cost Models as Hypothesis Tests

2018-08-29

We relate models based on costs of switching beliefs (e.g. due to inattention) to hypothesis tests. Specifically, for an inference problem with a penalty for mistakes and for switching the inferred value, a band of inact…