paper-with-me

Papers

Towards regularized learning from functional data with covariate shift

2026-01-28 · Markus Holzleitner, Sergiy Pereverzyev, Sergei V. Pereverzyev, Vaibhav Silmana, S. Sivananthan arxiv

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate shift occurs when the input distributions of the training and test data differ, introducing significant challenges for reliable learning. By restricting the hypothesis space, we develop a practical operator learning algorithm capable of handling functional outputs. We establish optimal convergence rates for the proposed framework under a general source condition, providing a theoretical foundation for regularized learning in this setting. We also propose an aggregation-based approach that forms a linear combination of estimators corresponding to different regularization parameters and different kernels. The proposed approach addresses the challenge of selecting appropriate tuning parameters, which is crucial for constructing a good estimator, and we provide a theoretical justification for its effectiveness. Furthermore, we illustrate the proposed method on a real-world face image dataset, demonstrating robustness and effectiveness in mitigating distributional discrepancies under covariate shift.

📄 PDF Abstract BibTeX arXiv:2601.21019

Code (0)

등록된 구현이 없습니다.

Tasks

Unsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

L1-Regularized Functional Support Vector Machine

2025-08-07 · Bingfan Liu, Peijun Sang arxiv

In functional data analysis, binary classification with one functional covariate has been extensively studied. We aim to fill in the gap of considering multivariate functional covariates in classification. In particular,…

Binary Classification

Importance Weighting Correction of Regularized Least-Squares for Covariate and Target Shifts

2022-10-18 · Davit Gogolashvili

In many real world problems, the training data and test data have different distributions. This situation is commonly referred as a dataset shift. The most common settings for dataset shift often considered in the litera…

regression

High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

2024-06-05 · Yihang Chen, Fanghui Liu, Taiji Suzuki, Volkan Cevher

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate …

Likelihood-Ratio Regularized Quantile Regression: Adapting Conformal Prediction to High-Dimensional Covariate Shifts

2025-02-18 · Sunay Joshi, Shayan Kiyani, George Pappas, Edgar Dobriban 외

We consider the problem of conformal prediction under covariate shift. Given labeled data from a source domain and unlabeled data from a covariate shifted target domain, we seek to construct prediction sets with valid ma…

Conformal Predictionimage-classificationImage ClassificationLearning Theory+4

Wasserstein-regularized Conformal Prediction under General Distribution Shift

2025-01-23 · Rui Xu, Chao Chen, Yue Sun, Parvathinathan Venkitasubramaniam 외

Conformal prediction yields a prediction set with guaranteed $1-\alpha$ coverage of the true target under the i.i.d. assumption, which may not hold and lead to a gap between $1-\alpha$ and the actual coverage. Prior stud…

Conformal PredictionPredictionRepresentation Learning