paper-with-me

홈 › Papers

Confidence Intervals for Selected Parameters

2019-06-02 · Yoav Benjamini, Yotam Hechtlinger, Philip B. Stark

Practical or scientific considerations often lead to selecting a subset of parameters as `important.'' Inferences about those parameters often are based on the same data used to select them in the first place. That can make the reported uncertainties deceptively optimistic: confidence intervals that ignore selection generally have less than their nominal coverage probability. Controlling the probability that one or more intervals for selected parameters do not cover---the simultaneous over the selected'' (SoS) error rate---is crucial in many scientific problems. Intervals that control the SoS error rate can be constructed in ways that take advantage of knowledge of the selection rule. We construct SoS-controlling confidence intervals for parameters deemed the most `important'' $k$ of $m$ shift parameters because they are estimated (by independent estimators) to be the largest. The new intervals improve substantially over \v{S}id\'{a}k intervals when $k$ is small compared to $m$, and approach the standard Bonferroni-corrected intervals when $k \approx m$. Standard, unadjusted confidence intervals for location parameters have the correct coverage probability for $k=1$, $m=2$ if, when the true parameters are zero, the estimators are exchangeable and symmetric.

📄 PDF Abstract BibTeX arXiv:1906.00505

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Inference for Interval-Identified Parameters Selected from an Estimated Set

2024-03-01 · Sukjin Han, Adam McCloskey

Interval identification of parameters such as average treatment effects, average partial effects and welfare is particularly common when using observational data and experimental data with imperfect compliance due to the…

Short and Simple Confidence Intervals when the Directions of Some Effects are Known

2021-09-16 · Philipp Ketz, Adam McCloskey

We provide adaptive confidence intervals on a parameter of interest in the presence of nuisance parameters when some of the nuisance parameters have known signs. The confidence intervals are adaptive in the sense that th…

valid

In Defense of the Indefensible: A Very Naive Approach to High-Dimensional Inference

2017-05-16 · Sen Zhao, Daniela Witten, Ali Shojaie

A great deal of interest has recently focused on conducting inference on the parameters in a high-dimensional linear model. In this paper, we consider a simple and very na\"{i}ve two-step procedure for this task, in whic…

regressionvalid

Differentially Private Confidence Intervals for Empirical Risk Minimization

2018-04-11 · Yue Wang, Daniel Kifer, Jaewoo Lee

The process of data mining with differential privacy produces results that are affected by two types of noise: sampling noise due to data collection and privacy noise that is designed to prevent the reconstruction of sen…

BIG-bench Machine Learning

Calibrated Projection in MATLAB: Users' Manual

2017-10-24

We present the calibrated-projection MATLAB package implementing the method to construct confidence intervals proposed by Kaido, Molinari and Stoye (2017). This manual provides details on how to use the package for infer…