Conditional Testing based on Localized Conformal p-values
In this paper, we address conditional testing problems through the conformal inference framework. We define the localized conformal p-values by inverting prediction intervals and prove their theoretical properties. These defined p-values are then applied to several conditional testing problems to illustrate their practicality. Firstly, we propose a conditional outlier detection procedure to test for outliers in the conditional distribution with finite-sample false discovery rate (FDR) control. We also introduce a novel conditional label screening problem with the goal of screening multivariate response variables and propose a screening procedure to control the family-wise error rate (FWER). Finally, we consider the two-sample conditional distribution test and define a weighted U-statistic through the aggregation of localized p-values. Numerical simulations and real-data examples validate the superior performance of our proposed strategies.
Code (0)
등록된 구현이 없습니다.
Tasks
Outlier DetectionPrediction IntervalsSimilar Papers 제목 키워드 기반
Distribution-free Conformal Prediction for Ordinal Classification
Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal cl…
ClassificationConformal PredictionOrdinal ClassificationPrediction+1Beyond Marginal Validity: Finite-Sample Guarantees for Localized Conformal Prediction
Conformal prediction endows arbitrary black-box predictors with finite-sample, distribution-free marginal coverage, yet marginal validity can hide severe covariate-specific miscalibration, while exact distribution-free c…
Testing for Outliers with Conformal p-values
This paper studies the construction of p-values for nonparametric outlier detection, taking a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a referen…
Outlier DetectionvalidMD-split+: Practical Local Conformal Inference in High Dimensions
Quantifying uncertainty in model predictions is a common goal for practitioners seeking more than just point predictions. One tool for uncertainty quantification that requires minimal assumptions is conformal inference, …
Conformal PredictionDensity EstimationOpen-Ended Question AnsweringPrediction+3Conformal Prediction with Missing Values
Conformal prediction is a theoretically grounded framework for constructing predictive intervals. We study conformal prediction with missing values in the covariates -- a setting that brings new challenges to uncertainty…
Conformal PredictionData AugmentationImputationMissing Values+6