Computational Efficiency under Covariate Shift in Kernel Ridge Regression
This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and test data differ, presenting additional challenges for learning. Although kernel methods have optimal statistical properties, their high computational demands in terms of time and, particularly, memory, limit their scalability to large datasets. To address this limitation, the main focus of this paper is to explore the trade-off between computational efficiency and statistical accuracy under covariate shift. We investigate the use of random projections where the hypothesis space consists of a random subspace within a given RKHS. Our results show that, even in the presence of covariate shift, significant computational savings can be achieved without compromising learning performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Contextual Optimization under Covariate Shift: A Robust Approach by Intersecting Wasserstein Balls
In contextual optimization, a decision-maker leverages contextual information, often referred to as covariates, to better resolve uncertainty and make informed decisions. In this paper, we examine the challenges of conte…
Computational EfficiencyPortfolio OptimizationHigh-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization
This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate …
Simulator Calibration under Covariate Shift with Kernels
We propose a novel calibration method for computer simulators, dealing with the problem of covariate shift. Covariate shift is the situation where input distributions for training and test are different, and ubiquitous i…
Bayesian InferenceImportance Weighting Correction of Regularized Least-Squares for Covariate and Target Shifts
In many real world problems, the training data and test data have different distributions. This situation is commonly referred as a dataset shift. The most common settings for dataset shift often considered in the litera…
regressionOptimally tackling covariate shift in RKHS-based nonparametric regression
We study the covariate shift problem in the context of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We focus on two natural families of covariate shift problems defined using the likelihood ra…
regression