paper-with-me

홈 › Papers

Mercer Features for Efficient Combinatorial Bayesian Optimization

2020-12-14 · Aryan Deshwal, Syrine Belakaria, Janardhan Rao Doppa

Bayesian optimization (BO) is an efficient framework for solving black-box optimization problems with expensive function evaluations. This paper addresses the BO problem setting for combinatorial spaces (e.g., sequences and graphs) that occurs naturally in science and engineering applications. A prototypical example is molecular optimization guided by expensive experiments. The key challenge is to balance the complexity of statistical models and tractability of search to select combinatorial structures for evaluation. In this paper, we propose an efficient approach referred as Mercer Features for Combinatorial Bayesian Optimization (MerCBO). The key idea behind MerCBO is to provide explicit feature maps for diffusion kernels over discrete objects by exploiting the structure of their combinatorial graph representation. These Mercer features combined with Thompson sampling as the acquisition function allows us to employ tractable solvers to find next structures for evaluation. Experiments on diverse real-world benchmarks demonstrate that MerCBO performs similarly or better than prior methods. The source code is available at https://github.com/aryandeshwal/MerCBO .

📄 PDF Abstract BibTeX arXiv:2012.07762

Code (1)

aryandeshwal/MerCBO 공식 구현 pytorch

Tasks

Bayesian OptimizationThompson Sampling

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Bayesian neural networks with interpretable priors from Mercer kernels

2025-10-27 · Alex Alberts, Ilias Bilionis arxiv

Quantifying the uncertainty in the output of a neural network is essential for deployment in scientific or engineering applications where decisions must be made under limited or noisy data. Bayesian neural networks (BNNs…

Gaussian Processes

Combinatorial Bayesian Optimization with Random Mapping Functions to Convex Polytopes

2020-11-26 · Jungtaek Kim, Seungjin Choi, Minsu Cho

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which …

Bayesian Optimizationglobal-optimization

Differentiable TAN Structure Learning for Bayesian Network Classifiers

2020-08-21 · Wolfgang Roth, Franz Pernkopf

Learning the structure of Bayesian networks is a difficult combinatorial optimization problem. In this paper, we consider learning of tree-augmented naive Bayes (TAN) structures for Bayesian network classifiers with disc…

Combinatorial Optimization

Bayesian Variational Optimization for Combinatorial Spaces

2020-11-03 · Tony C. Wu, Daniel Flam-Shepherd, Alán Aspuru-Guzik

This paper focuses on Bayesian Optimization in combinatorial spaces. In many applications in the natural science. Broad applications include the study of molecules, proteins, DNA, device structures and quantum circuit de…

Bayesian OptimizationGaussian Processes

Bayesian Optimization of Combinatorial Structures

2018-06-22 · ICML 2018 7 · Ricardo Baptista, Matthias Poloczek

The optimization of expensive-to-evaluate black-box functions over combinatorial structures is an ubiquitous task in machine learning, engineering and the natural sciences. The combinatorial explosion of the search space…

Bayesian OptimizationBIG-bench Machine Learning