paper-with-me

홈 › Papers

Non-Parametric Rehearsal Learning via Conditional Mean Embeddings

2026-05-09 · Wen-Bo Du, Tian-Zuo Wang, Han-Jia Ye, Zhi-Hua Zhou arxiv

In machine learning, a critical class of decision-related problems concerns preventing predicted undesirable outcomes, referred to as the \textit{avoiding undesired future} (AUF) problem. To address this, the \textit{rehearsal learning} framework has been proposed to model influence relations for effective decisions. However, existing rehearsal methods rely on restrictive parametric assumptions such as linear systems or additive noise, limiting their practical applicability. In this paper, we propose the first non-parametric rehearsal learning approach for AUF without assuming specific functional forms of data generation processes. Specifically, we use kernel machinery to reformulate the AUF objective into a unified representation that disentangles desirability modeling from action-induced distributional changes. To handle the discontinuity of desirability indicator, we present a smooth Probit surrogate and provide an approximation error bound. Meanwhile, we capture the action-induced changes via conditional mean embeddings, and develop a kernel ridge regression based nested estimator for AUF objective with consistency guarantees. Such a formulation naturally accommodates nonlinear systems and non-additive noise, and empirical results on synthetic and real-data-derived semi-synthetic benchmarks demonstrate the effectiveness and flexibility of our approach.

📄 PDF Abstract BibTeX arXiv:2605.08999

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bayesian Deconditional Kernel Mean Embeddings

2019-06-01 · Kelvin Hsu, Fabio Ramos

Conditional kernel mean embeddings form an attractive nonparametric framework for representing conditional means of functions, describing the observation processes for many complex models. However, the recovery of the or…

Gaussian Processes

Verifiable Regularity Criterion for Conditional Expectation Operators and Conditional Mean Embeddings with Applications to Nonparametric Regression, Bayesian Inverse Problems, and Koopman Operators

2026-08-06 · Maximiliano Hertel, Ilja Klebanov, Manuel Schaller, Karl Worthmann arxiv

Conditional expectation operators (CEOs) and their associated conditional mean embeddings (CMEs) play a central role across applied mathematics and machine learning, appearing in nonparametric regression, Bayesian invers…

Measuring Differences between Conditional Distributions using Kernel Embeddings

2026-05-04 · Peter Moskvichev, Siu Lun Chau, Dino Sejdinovic arxiv

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddi…

Hyperparameter Learning for Conditional Kernel Mean Embeddings with Rademacher Complexity Bounds

2018-09-01 · Kelvin Hsu, Richard Nock, Fabio Ramos

Conditional kernel mean embeddings are nonparametric models that encode conditional expectations in a reproducing kernel Hilbert space. While they provide a flexible and powerful framework for probabilistic inference, th…

Bayesian Learning of Conditional Kernel Mean Embeddings for Automatic Likelihood-Free Inference

2019-03-03 · Kelvin Hsu, Fabio Ramos

In likelihood-free settings where likelihood evaluations are intractable, approximate Bayesian computation (ABC) addresses the formidable inference task to discover plausible parameters of simulation programs that explai…