paper-with-me

홈 › Papers

Beyond Expected Information Gain: Stable Bayesian Optimal Experimental Design with Integral Probability Metrics and Plug-and-Play Extensions

2026-04-23 · Di Wu, Ling Liang, Haizhao Yang arxiv

Bayesian Optimal Experimental Design (BOED) provides a rigorous framework for decision-making tasks in which data acquisition is often the critical bottleneck, especially in resource-constrained settings. Traditionally, BOED typically selects designs by maximizing expected information gain (EIG), commonly defined through the Kullback-Leibler (KL) divergence. However, classical evaluation of EIG often involves challenging nested expectations, and even advanced variational methods leave the underlying log-density-ratio objective unchanged. As a result, support mismatch, tail underestimation, and rare-event sensitivity remain intrinsic concerns for KL-based BOED. To address these fundamental bottlenecks, we introduce an IPM-based BOED framework that replaces density-based divergences with integral probability metrics (IPMs), including the Wasserstein distance, Maximum Mean Discrepancy, and Energy Distance, resulting in a highly flexible plug-and-play BOED framework. We establish theoretical guarantees showing that IPM-based utilities provide stronger geometry-aware stability under surrogate-model error and prior misspecification than classical EIG-based utilities. We also validate the proposed framework empirically, demonstrating that IPM-based designs yield highly concentrated credible sets. Furthermore, by extending the same sample-based BOED template in a plug-and-play manner to geometry-aware discrepancies beyond the IPM class, illustrated by a neural optimal transport estimator, we achieve accurate optimal designs in high-dimensional settings where conventional nested Monte Carlo estimators and advanced variational methods fail.

📄 PDF Abstract BibTeX arXiv:2604.21849

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Metrics for Bayesian Optimal Experiment Design under Model Misspecification

2023-04-17 · Tommie A. Catanach, Niladri Das

The conventional approach to Bayesian decision-theoretic experiment design involves searching over possible experiments to select a design that maximizes the expected value of a specified utility function. The expectatio…

Active inference, Bayesian optimal design, and expected utility

2021-09-21 · Noor Sajid, Lancelot Da Costa, Thomas Parr, Karl Friston

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how …

Unbiased MLMC stochastic gradient-based optimization of Bayesian experimental designs

2020-05-18 · Takashi Goda, Tomohiko Hironaka, Wataru Kitade, Adam Foster

In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with…

Experimental DesignStochastic Optimization

Robust Bayesian Decision Making under Adversarial Uncertainty

2026-07-09 · Haripriya Harikumar, Sammie Katt, Yasir Zubayr Barlas, Samuel Kaski arxiv

Scientific experiments are often designed to maximize information gain, yet in many applications the primary objective is to support reliable downstream decision-making. Existing decision-aware experimental design and ac…

Active LearningDecision Making

Robust Expected Information Gain for Optimal Bayesian Experimental Design Using Ambiguity Sets

2022-05-20 · Jinwoo Go, Tobin Isaac

The ranking of experiments by expected information gain (EIG) in Bayesian experimental design is sensitive to changes in the model's prior distribution, and the approximation of EIG yielded by sampling will have errors s…

Experimental Design