paper-with-me

홈 › Papers

RBFOpt: an open-source library for black-box optimization with costly function evaluations

2015-11-05 · Mathematical Programming Computation 2018 2015 11 · Alberto Costa, Giacomo Nannicini

We consider the problem of optimizing an unknown function given as an oracle over a mixed-integer box-constrained set. We assume that the oracle is expensive to evaluate, so that estimating partial derivatives by finite differences is impractical. In the literature, this is typically called a black-box optimization problem with costly evaluation. This paper describes the solution methodology implemented in the open-source library RBFOpt, available on COIN-OR. The algorithm is based on the Radial Basis Function method originally proposed by Gutmann (J Glob Optim 19:201–227, 2001.), which builds and iteratively refines a surrogate model of the unknown objective function. The two main methodological contributions of this paper are an approach to exploit a noisy but less expensive oracle to accelerate convergence to the optimum of the exact oracle, and the introduction of an automatic model selection phase during the optimization process. Numerical experiments show that RBFOpt is highly competitive on a test set of continuous and mixed-integer nonlinear unconstrained problems taken from the literature: it outperforms the open-source solvers included in our comparison by a large amount, and performs slightly better than a commercial solver. Our empirical evaluation provides insight on which parameterizations of the algorithm are the most effective in practice. The software reviewed as part of this submission was given the Digital Object Identifier (DOI).

📄 PDF Abstract BibTeX

Code (1)

coin-or/rbfopt

Tasks

Hyperparameter OptimizationModel Selection

Similar Papers 제목 키워드 기반

On the implementation of a global optimization method for mixed-variable problems

2020-09-04 · Giacomo Nannicini

We describe the optimization algorithm implemented in the open-source derivative-free solver RBFOpt. The algorithm is based on the radial basis function method of Gutmann and the metric stochastic response surface method…

global-optimization

PyXAB -- A Python Library for $\mathcal{X}$-Armed Bandit and Online Blackbox Optimization Algorithms

2023-03-07 · Wenjie Li, Haoze Li, Jean Honorio, Qifan Song

We introduce a Python open-source library for $\mathcal{X}$-armed bandit and online blackbox optimization named PyXAB. PyXAB contains the implementations for more than 10 $\mathcal{X}$-armed bandit algorithms, such as HO…

QDax: A Library for Quality-Diversity and Population-based Algorithms with Hardware Acceleration

2023-08-07 · Felix Chalumeau, Bryan Lim, Raphael Boige, Maxime Allard 외

QDax is an open-source library with a streamlined and modular API for Quality-Diversity (QD) optimization algorithms in Jax. The library serves as a versatile tool for optimization purposes, ranging from black-box optimi…

continuous-controlContinuous ControlDiversityreinforcement-learning+1

VOPy: A Framework for Black-box Vector Optimization

2024-12-09 · Yaşar Cahit Yıldırım, Efe Mert Karagözlü, İlter Onat Korkmaz, Çağın Ararat 외

We introduce VOPy, an open-source Python library designed to address black-box vector optimization, where multiple objectives must be optimized simultaneously with respect to a partial order induced by a convex cone. VOP…

From Complexity to Simplicity: Adaptive ES-Active Subspaces for Blackbox Optimization

2019-03-07 · NeurIPS 2019 12 · Krzysztof Choromanski, Aldo Pacchiano, Jack Parker-Holder, Yunhao Tang

We present a new algorithm ASEBO for optimizing high-dimensional blackbox functions. ASEBO adapts to the geometry of the function and learns optimal sets of sensing directions, which are used to probe it, on-the-fly. It …

compressed sensingMulti-Armed BanditsReinforcement Learning