paper-with-me

Papers

Continuous surrogate-based optimization algorithms are well-suited for expensive discrete problems

2020-11-06 · Rickard Karlsson, Laurens Bliek, Sicco Verwer, Mathijs de Weerdt

One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an approximate solution to the original problem. In the case of discrete problems, recent research has revolved around surrogate models that are specifically constructed to deal with discrete structures. A main motivation is that literature considers continuous methods, such as Bayesian optimization with Gaussian processes as the surrogate, to be sub-optimal (especially in higher dimensions) because they ignore the discrete structure by, e.g., rounding off real-valued solutions to integers. However, we claim that this is not true. In fact, we present empirical evidence showing that the use of continuous surrogate models displays competitive performance on a set of high-dimensional discrete benchmark problems, including a real-life application, against state-of-the-art discrete surrogate-based methods. Our experiments on different discrete structures and time constraints also give more insight into which algorithms work well on which type of problem.

📄 PDF Abstract BibTeX arXiv:2011.03431

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationGaussian Processes

Similar Papers 제목 키워드 기반

Black-box Combinatorial Optimization using Models with Integer-valued Minima

2019-11-20 · Laurens Bliek, Sicco Verwer, Mathijs de Weerdt

When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exac…

Bayesian OptimizationCombinatorial Optimization

Learning Sparse Decision Trees via Transformer Variational Auto-Encoders

2026-09-01 · Giacomo Fidone, Alessio Cascione, Riccardo Guidotti hf

Decision trees are among the most widely used models in machine learning, largely due to their transparent decision logic, making them well-suited for high-stakes decision-making contexts. However, most existing learning…

Rollout Algorithms and Approximate Dynamic Programming for Bayesian Optimization and Sequential Estimation

2022-12-15 · Dimitri Bertsekas

We provide a unifying approximate dynamic programming framework that applies to a broad variety of problems involving sequential estimation. We consider first the construction of surrogate cost functions for the purposes…

Bayesian Optimization

Bayesian Optimization for Mixed-Variable Problems in the Natural Sciences

2026-04-08 · Yuhao Zhang, Ti John, Matthias Stosiek, Patrick Rinke arxiv

Optimizing expensive black-box objectives over mixed search spaces is a common challenge across the natural sciences. Bayesian optimization (BO) offers sample-efficient strategies through probabilistic surrogate models a…

Black-Box Optimization From Small Offline Datasets via Meta Learning with Synthetic Tasks

2026-04-14 · Azza Fadhel, The Hung Tran, Trong Nghia Hoang, Jana Doppa arxiv

We consider the problem of offline black-box optimization, where the goal is to discover optimal designs (e.g., molecules or materials) from past experimental data. A key challenge in this setting is data scarcity: in ma…