paper-with-me

홈 › Papers

Semi-Supervised Quantile Estimation: Robust and Efficient Inference in High Dimensional Settings

2022-01-25 · Abhishek Chakrabortty, Guorong Dai, Raymond J. Carroll

We consider quantile estimation in a semi-supervised setting, characterized by two available data sets: (i) a small or moderate sized labeled data set containing observations for a response and a set of possibly high dimensional covariates, and (ii) a much larger unlabeled data set where only the covariates are observed. We propose a family of semi-supervised estimators for the response quantile(s) based on the two data sets, to improve the estimation accuracy compared to the supervised estimator, i.e., the sample quantile from the labeled data. These estimators use a flexible imputation strategy applied to the estimating equation along with a debiasing step that allows for full robustness against misspecification of the imputation model. Further, a one-step update strategy is adopted to enable easy implementation of our method and handle the complexity from the non-linear nature of the quantile estimating equation. Under mild assumptions, our estimators are fully robust to the choice of the nuisance imputation model, in the sense of always maintaining root-n consistency and asymptotic normality, while having improved efficiency relative to the supervised estimator. They also attain semi-parametric optimality if the relation between the response and the covariates is correctly specified via the imputation model. As an illustration of estimating the nuisance imputation function, we consider kernel smoothing type estimators on lower dimensional and possibly estimated transformations of the high dimensional covariates, and we establish novel results on their uniform convergence rates in high dimensions, involving responses indexed by a function class and usage of dimension reduction techniques. These results may be of independent interest. Numerical results on both simulated and real data confirm our semi-supervised approach's improved performance, in terms of both estimation and inference.

📄 PDF Abstract BibTeX arXiv:2201.10208

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionImputation

Similar Papers 제목 키워드 기반

Prediction-powered Inference by Mixture of Experts

2026-04-30 · Yanwu Gu, Linglong Kong, Dong Xia arxiv

The rapidly expanding artificial intelligence (AI) industry has produced diverse yet powerful prediction tools, each with its own network architecture, training strategy, data-processing pipeline, and domain-specific str…

Bayesian Quantile Regression with Subset Selection: A Decision Analysis Perspective

2023-11-03 · Joseph Feldman, Daniel Kowal

Quantile regression is a powerful tool for inferring how covariates affect specific percentiles of the response distribution. Existing methods either estimate conditional quantiles separately for each quantile of interes…

Density Estimationquantile regressionregressionUncertainty Quantification+1

Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

2026-07-09 · Zijie Cheng, Yang Peng, Zhihua Zhang arxiv

In this paper, we study quantile-based distributional reinforcement learning from the perspective of statistical efficiency. We focus on distributional policy evaluation, whose goal is to characterize the return distribu…

Reinforcement Learning

Nonparametric Expected Shortfall Forecasting Incorporating Weighted Quantiles

2020-05-11 · Giuseppe Storti, Chao Wang

A new semi-parametric Expected Shortfall (ES) estimation and forecasting framework is proposed. The proposed approach is based on a two-step estimation procedure. The first step involves the estimation of Value-at-Risk (…

quantile regressionTime SeriesTime Series Analysis

A Semiparametric Bayesian Extreme Value Model Using a Dirichlet Process Mixture of Gamma Densities

2013-04-02 · Jairo Fuquene

In this paper we propose a model with a Dirichlet process mixture of gamma densities in the bulk part below threshold and a generalized Pareto density in the tail for extreme value estimation. The proposed model is simpl…

Density Estimation