paper-with-me

홈 › Papers

Kernel Ridge Regression Inference

2023-02-13 · Rahul Singh, Suhas Vijaykumar

We provide uniform inference and confidence bands for kernel ridge regression (KRR), a widely-used non-parametric regression estimator for general data types including rankings, images, and graphs. Despite the prevalence of these data -- e.g., ranked preference lists in school assignment -- the inferential theory of KRR is not fully known, limiting its role in economics and other scientific domains. We construct sharp, uniform confidence sets for KRR, which shrink at nearly the minimax rate, for general regressors. To conduct inference, we develop an efficient bootstrap procedure that uses symmetrization to cancel bias and limit computational overhead. To justify the procedure, we derive finite-sample, uniform Gaussian and bootstrap couplings for partial sums in a reproducing kernel Hilbert space (RKHS). These imply strong approximation for empirical processes indexed by the RKHS unit ball with logarithmic dependence on the covering number. Simulations verify coverage. We use our procedure to construct a novel test for match effects in school assignment, an important question in education economics with consequences for school choice reforms.

📄 PDF Abstract BibTeX arXiv:2302.06578

Code (0)

등록된 구현이 없습니다.

Tasks

regressionvalid

Similar Papers 제목 키워드 기반

A Comparative Study of Pairwise Learning Methods based on Kernel Ridge Regression

2018-03-05 · Michiel Stock, Tapio Pahikkala, Antti Airola, Bernard De Baets 외

Many machine learning problems can be formulated as predicting labels for a pair of objects. Problems of that kind are often referred to as pairwise learning, dyadic prediction or network inference problems. During the l…

BIG-bench Machine LearningregressionZero-Shot Learning

Statistical Inference after Kernel Ridge Regression Imputation under item nonresponse

2021-01-29 · Hengfang Wang, Jae-Kwang Kim

Imputation is a popular technique for handling missing data. We consider a nonparametric approach to imputation using the kernel ridge regression technique and propose consistent variance estimation. The proposed varianc…

Imputationregression

Conjugate Gradients for Kernel Machines

2019-11-14 · Simon Bartels, Philipp Hennig

Regularized least-squares (kernel-ridge / Gaussian process) regression is a fundamental algorithm of statistics and machine learning. Because generic algorithms for the exact solution have cubic complexity in the number …

BIG-bench Machine Learningregression

Statistical inference using Regularized M-estimation in the reproducing kernel Hilbert space for handling missing data

2021-07-15 · Hengfang Wang, Jae Kwang Kim

Imputation and propensity score weighting are two popular techniques for handling missing data. We address these problems using the regularized M-estimation techniques in the reproducing kernel Hilbert space. Specificall…

Imputationregression

How Many Machines Can We Use in Parallel Computing for Kernel Ridge Regression?

2018-05-25 · Meimei Liu, Zuofeng Shang, Guang Cheng

This paper aims to solve a basic problem in distributed statistical inference: how many machines can we use in parallel computing? In kernel ridge regression, we address this question in two important settings: nonparame…

regressionTwo-sample testing