paper-with-me

홈 › Papers

Comparing Algorithm Selection Approaches on Black-Box Optimization Problems

2023-06-30 · Ana Kostovska, Anja Jankovic, Diederick Vermetten, Sašo Džeroski, Tome Eftimov, Carola Doerr

Performance complementarity of solvers available to tackle black-box optimization problems gives rise to the important task of algorithm selection (AS). Automated AS approaches can help replace tedious and labor-intensive manual selection, and have already shown promising performance in various optimization domains. Automated AS relies on machine learning (ML) techniques to recommend the best algorithm given the information about the problem instance. Unfortunately, there are no clear guidelines for choosing the most appropriate one from a variety of ML techniques. Tree-based models such as Random Forest or XGBoost have consistently demonstrated outstanding performance for automated AS. Transformers and other tabular deep learning models have also been increasingly applied in this context. We investigate in this work the impact of the choice of the ML technique on AS performance. We compare four ML models on the task of predicting the best solver for the BBOB problems for 7 different runtime budgets in 2 dimensions. While our results confirm that a per-instance AS has indeed impressive potential, we also show that the particular choice of the ML technique is of much minor importance.

📄 PDF Abstract BibTeX arXiv:2306.17585

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MA-BBOB: Many-Affine Combinations of BBOB Functions for Evaluating AutoML Approaches in Noiseless Numerical Black-Box Optimization Contexts

2023-06-18 · Diederick Vermetten, Furong Ye, Thomas Bäck, Carola Doerr

Extending a recent suggestion to generate new instances for numerical black-box optimization benchmarking by interpolating pairs of the well-established BBOB functions from the COmparing COntinuous Optimizers (COCO) plat…

AutoMLBenchmarking

Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization

2021-09-17 · Ryoji Tanabe

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently r…

Benchmarking

Greedy Restart Schedules: A Baseline for Dynamic Algorithm Selection on Numerical Black-box Optimization Problems

2025-04-15 · Lennart Schäpermeier

In many optimization domains, there are multiple different solvers that contribute to the overall state-of-the-art, each performing better on some, and worse on other types of problem instances. Meta-algorithmic approach…

Scheduling

Similarity-based Portfolio Construction for Black-box Optimization

2026-04-20 · Catalin-Viorel Dinu, Diederick Vermetten, Carola Doerr arxiv

In black-box optimization, a central question is which algorithm to use to solve a given, previously unseen, problem. Selecting a single algorithm, however, entails inherent risks: inaccuracies in the selector may lead t…

Speeding-up Evolutionary Algorithms to solve Black-Box Optimization Problems

2023-09-23 · Judith Echevarrieta, Etor Arza, Aritz Pérez

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given popula…

Evolutionary Algorithms