paper-with-me

홈 › Papers

Efficient Robust Bayesian Optimization for Arbitrary Uncertain Inputs

2023-10-31 · NeurIPS 2023 11

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such as machining errors, execution noise, or contextual variability. This uncertainty deviates the input from the intended value before evaluation, resulting in significant performance fluctuations in the final result. In this paper, we introduce a novel robust Bayesian Optimization algorithm, AIRBO, which can effectively identify a robust optimum that performs consistently well under arbitrary input uncertainty. Our method directly models the uncertain inputs of arbitrary distributions by empowering the Gaussian Process with the Maximum Mean Discrepancy (MMD) and further accelerates the posterior inference via Nystrom approximation. Rigorous theoretical regret bound is established under MMD estimation error and extensive experiments on synthetic functions and real problems demonstrate that our approach can handle various input uncertainties and achieve state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2310.20145

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimization

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Designing over uncertain outcomes with stochastic sampling Bayesian optimization

2019-11-05 · Peter D. Tonner, Daniel V. Samarov, A. Gilad Kusne

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimizat…

Bayesian OptimizationDecision Making

Graph Bayesian Optimization: Algorithms, Evaluations and Applications

2018-05-03 · Jiaxu Cui, Bo Yang

Network structure optimization is a fundamental task in complex network analysis. However, almost all the research on Bayesian optimization is aimed at optimizing the objective functions with vectorial inputs. In this wo…

Bayesian Optimization

Bayesian Parameter Shift Rule in Variational Quantum Eigensolvers

2025-02-04 · Samuele Pedrielli, Christopher J. Anders, Lena Funcke, Karl Jansen 외

Parameter shift rules (PSRs) are key techniques for efficient gradient estimation in variational quantum eigensolvers (VQEs). In this paper, we propose its Bayesian variant, where Gaussian processes with appropriate kern…

Gaussian Processes

Can Bayesian Neural Networks Explicitly Model Input Uncertainty?

2025-01-14 · Matias Valdenegro-Toro, Marco Zullich

Inputs to machine learning models can have associated noise or uncertainties, but they are often ignored and not modelled. It is unknown if Bayesian Neural Networks and their approximations are able to consider uncertain…

model

Bayesian sequential design of computer experiments for quantile set inversion

2022-11-02 · Romain Ait Abdelmalek-Lomenech, Julien Bect, Vincent Chabridon, Emmanuel Vazquez

We consider an unknown multivariate function representing a system-such as a complex numerical simulator-taking both deterministic and uncertain inputs. Our objective is to estimate the set of deterministic inputs leadin…