paper-with-me

홈 › Papers

PyBADS: Fast and robust black-box optimization in Python

2023-06-27 · Gurjeet Sangra Singh, Luigi Acerbi

PyBADS is a Python implementation of the Bayesian Adaptive Direct Search (BADS) algorithm for fast and robust black-box optimization (Acerbi and Ma 2017). BADS is an optimization algorithm designed to efficiently solve difficult optimization problems where the objective function is rough (non-convex, non-smooth), mildly expensive (e.g., the function evaluation requires more than 0.1 seconds), possibly noisy, and gradient information is unavailable. With BADS, these issues are well addressed, making it an excellent choice for fitting computational models using methods such as maximum-likelihood estimation. The algorithm scales efficiently to black-box functions with up to $D \approx 20$ continuous input parameters and supports bounds or no constraints. PyBADS comes along with an easy-to-use Pythonic interface for running the algorithm and inspecting its results. PyBADS only requires the user to provide a Python function for evaluating the target function, and optionally other constraints. Extensive benchmarks on both artificial test problems and large real model-fitting problems models drawn from cognitive, behavioral and computational neuroscience, show that BADS performs on par with or better than many other common and state-of-the-art optimizers (Acerbi and Ma 2017), making it a general model-fitting tool which provides fast and robust solutions.

📄 PDF Abstract BibTeX arXiv:2306.15576

Code (1)

acerbilab/pybads 공식 구현

Similar Papers 제목 키워드 기반

PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization

2022-12-12 · Qiqi Duan, Guochen Zhou, Chang Shao, Zhuowei Wang 외

In this paper, we present an open-source pure-Python library called PyPop7 for black-box optimization (BBO). As population-based methods (e.g., evolutionary algorithms, swarm intelligence, and pattern search) become incr…

BenchmarkingEvolutionary AlgorithmsMetric Learning

A Joint Python/C++ Library for Efficient yet Accessible Black-Box and Gray-Box Optimization with GOMEA

2023-05-10 · Anton Bouter, Peter A. N. Bosman

Exploiting knowledge about the structure of a problem can greatly benefit the efficiency and scalability of an Evolutionary Algorithm (EA). Model-Based EAs (MBEAs) are capable of doing this by explicitly modeling the pro…

PyXAB -- A Python Library for $\mathcal{X}$-Armed Bandit and Online Blackbox Optimization Algorithms

2023-03-07 · Wenjie Li, Haoze Li, Jean Honorio, Qifan Song

We introduce a Python open-source library for $\mathcal{X}$-armed bandit and online blackbox optimization named PyXAB. PyXAB contains the implementations for more than 10 $\mathcal{X}$-armed bandit algorithms, such as HO…

VOPy: A Framework for Black-box Vector Optimization

2024-12-09 · Yaşar Cahit Yıldırım, Efe Mert Karagözlü, İlter Onat Korkmaz, Çağın Ararat 외

We introduce VOPy, an open-source Python library designed to address black-box vector optimization, where multiple objectives must be optimized simultaneously with respect to a partial order induced by a convex cone. VOP…

Rieoptax: Riemannian Optimization in JAX

2022-10-10 · Saiteja Utpala, Andi Han, Pratik Jawanpuria, Bamdev Mishra

We present Rieoptax, an open source Python library for Riemannian optimization in JAX. We show that many differential geometric primitives, such as Riemannian exponential and logarithm maps, are usually faster in Rieopta…

CPUGPURiemannian optimizationStochastic Optimization