paper-with-me

홈 › Papers

Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networks

2024-04-03 · Leonardo Ferreira Guilhoto, Paris Perdikaris

Operator learning is a rising field of scientific computing where inputs or outputs of a machine learning model are functions defined in infinite-dimensional spaces. In this paper, we introduce NEON (Neural Epistemic Operator Networks), an architecture for generating predictions with uncertainty using a single operator network backbone, which presents orders of magnitude less trainable parameters than deep ensembles of comparable performance. We showcase the utility of this method for sequential decision-making by examining the problem of composite Bayesian Optimization (BO), where we aim to optimize a function $f=g\circ h$, where $h:X\to C(\mathcal{Y},\mathbb{R}^{d_s})$ is an unknown map which outputs elements of a function space, and $g: C(\mathcal{Y},\mathbb{R}^{d_s})\to \mathbb{R}$ is a known and cheap-to-compute functional. By comparing our approach to other state-of-the-art methods on toy and real world scenarios, we demonstrate that NEON achieves state-of-the-art performance while requiring orders of magnitude less trainable parameters.

📄 PDF Abstract BibTeX arXiv:2404.03099

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDecision MakingOperator learningSequential Decision Making

Methods 이 논문이 사용한 방법론

Deep Ensembles 설명 없음

Similar Papers 제목 키워드 기반

Joint Composite Latent Space Bayesian Optimization

2023-11-03 · Natalie Maus, Zhiyuan Jerry Lin, Maximilian Balandat, Eytan Bakshy

Bayesian Optimization (BO) is a technique for sample-efficient black-box optimization that employs probabilistic models to identify promising input locations for evaluation. When dealing with composite-structured functio…

Bayesian Optimization

Bayesian Optimization of Composite Functions

2019-06-04 · Raul Astudillo, Peter I. Frazier

We consider optimization of composite objective functions, i.e., of the form $f(x)=g(h(x))$, where $h$ is a black-box derivative-free expensive-to-evaluate function with vector-valued outputs, and $g$ is a cheap-to-evalu…

Bayesian Optimization

BOIS: Bayesian Optimization of Interconnected Systems

2023-11-19 · Leonardo D. González, Victor M. Zavala

Bayesian optimization (BO) has proven to be an effective paradigm for the global optimization of expensive-to-sample systems. One of the main advantages of BO is its use of Gaussian processes (GPs) to characterize model …

Bayesian OptimizationChemical ProcessGaussian Processesglobal-optimization

Complementary Composite Minimization, Small Gradients in General Norms, and Applications

2021-01-26 · Jelena Diakonikolas, Cristóbal Guzmán

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmi…

regression

Optimizing High-Dimensional Physics Simulations via Composite Bayesian Optimization

2021-11-29 · Wesley Maddox, Qing Feng, Max Balandat

Physical simulation-based optimization is a common task in science and engineering. Many such simulations produce image- or tensor-based outputs where the desired objective is a function of those outputs, and optimizatio…

Bayesian OptimizationVocal Bursts Intensity Prediction