paper-with-me

홈 › Papers

Expected Diverse Utility (EDU): Diverse Bayesian Optimization of Expensive Computer Simulators

2024-10-02 · John Joshua Miller, Simon Mak, Benny Sun, Sai Ranjeet Narayanan, Suo Yang, Zongxuan Sun, Kenneth S. Kim, Chol-Bum Mike Kweon

The optimization of expensive black-box simulators arises in a myriad of modern scientific and engineering applications. Bayesian optimization provides an appealing solution, by leveraging a fitted surrogate model to guide the selection of subsequent simulator evaluations. In practice, however, the objective is often not to obtain a single good solution, but rather a `basket'' of good solutions from which users can choose for downstream decision-making. This need arises in our motivating application for real-time control of internal combustion engines for flight propulsion, where a diverse set of control strategies is essential for stable flight control. There has been little work on this front for Bayesian optimization. We thus propose a new Expected Diverse Utility (EDU) method that searches for diverse `$\epsilon$-optimal'' solutions: locally-optimal solutions within a tolerance level $\epsilon > 0$ from a global optimum. We show that EDU yields a closed-form acquisition function under a Gaussian process surrogate model, which facilitates efficient sequential queries via automatic differentiation. This closed form further reveals a novel exploration-exploitation-diversity trade-off, which incorporates the desired diversity property within the well-known exploration-exploitation trade-off. We demonstrate the improvement of EDU over existing methods in a suite of numerical experiments, then explore the EDU in two applications on rover trajectory optimization and engine control for flight propulsion.

📄 PDF Abstract BibTeX arXiv:2410.01196

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDiversity

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Cost-Aware Bayesian Optimization for Prototyping Interactive Devices

2026-02-02 · Thomas Langerak, Renate Zhang, Ziyuan Wang, Per Ola Kristensson 외 arxiv

Deciding which idea is worth prototyping is a central concern in iterative design. A prototype should be produced when the expected improvement is high and the cost is low. However, this is hard to decide, because costs …

Active inference, Bayesian optimal design, and expected utility

2021-09-21 · Noor Sajid, Lancelot Da Costa, Thomas Parr, Karl Friston

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how …

On the Effectiveness of Mode Exploration in Bayesian Model Averaging for Neural Networks

2021-12-07 · John T. Holodnak, Allan B. Wollaber

Multiple techniques for producing calibrated predictive probabilities using deep neural networks in supervised learning settings have emerged that leverage approaches to ensemble diverse solutions discovered during cycli…

Bayesian InferenceVariational Inference

Generative Bayesian Computation for Maximum Expected Utility

2024-08-28 · Nick Polson, Fabrizio Ruggeri, Vadim Sokolov

Generative Bayesian Computation (GBC) methods are developed to provide an efficient computational solution for maximum expected utility (MEU). We propose a density-free generative method based on quantiles that naturally…

Optimal Bayesian Recommendation Sets and Myopically Optimal Choice Query Sets

2010-12-01 · NeurIPS 2010 12 · Paolo Viappiani, Craig Boutilier

Bayesian approaches to utility elicitation typically adopt (myopic) expected value of information (EVOI) as a natural criterion for selecting queries. However, EVOI-optimization is usually computationally prohibitive. …