paper-with-me

홈 › Papers

Distributionally Robust Active Learning for Gaussian Process Regression

2025-02-24 · Shion Takeno, Yoshito Okura, Yu Inatsu, Aoyama Tatsuya, Tomonari Tanaka, Akahane Satoshi, Hiroyuki Hanada, Noriaki Hashimoto, Taro Murayama, Hanju Lee, Shinya Kojima, Ichiro Takeuchi

Gaussian process regression (GPR) or kernel ridge regression is a widely used and powerful tool for nonlinear prediction. Therefore, active learning (AL) for GPR, which actively collects data labels to achieve an accurate prediction with fewer data labels, is an important problem. However, existing AL methods do not theoretically guarantee prediction accuracy for target distribution. Furthermore, as discussed in the distributionally robust learning literature, specifying the target distribution is often difficult. Thus, this paper proposes two AL methods that effectively reduce the worst-case expected error for GPR, which is the worst-case expectation in target distribution candidates. We show an upper bound of the worst-case expected squared error, which suggests that the error will be arbitrarily small by a finite number of data labels under mild conditions. Finally, we demonstrate the effectiveness of the proposed methods through synthetic and real-world datasets.

📄 PDF Abstract BibTeX arXiv:2502.16870

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningGPRPredictionregression

Similar Papers 제목 키워드 기반

Distributionally-Robust Machine Learning Using Locally Differentially-Private Data

2020-06-24 · Farhad Farokhi

We consider machine learning, particularly regression, using locally-differentially private datasets. The Wasserstein distance is used to define an ambiguity set centered at the empirical distribution of the dataset corr…

BIG-bench Machine Learningregression

Distributionally Robust Multi-Output Regression Ranking

2021-09-27 · Shahabeddin Sotudian, Ruidi Chen, Ioannis Paschalidis

Despite their empirical success, most existing listwiselearning-to-rank (LTR) models are not built to be robust to errors in labeling or annotation, distributional data shift, or adversarial data perturbations. To fill t…

Drug Response PredictionregressionRetrieval

Distributionally Robust Learning

2021-08-20 · Ruidi Chen, Ioannis Ch. Paschalidis

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning…

Decision Makingregression

Selecting Optimal Decisions via Distributionally Robust Nearest-Neighbor Regression

2019-12-01 · NeurIPS 2019 12 · Ruidi Chen, Ioannis Paschalidis

This paper develops a prediction-based prescriptive model for optimal decision making that (i) predicts the outcome under each action using a robust nonlinear model, and (ii) adopts a randomized prescriptive policy deter…

Decision Makingregression

Active Learning for Manifold Gaussian Process Regression

2025-06-26 · Yuanxing Cheng, Lulu Kang, Yiwei Wang, Chun Liu

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method joint…

Active LearningDimensionality Reductionregression