paper-with-me

Papers

A portfolio approach to massively parallel Bayesian optimization

2021-10-18 · Mickael Binois, Nicholson Collier, Jonathan Ozik

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by building a surrogate model of the black-box to simultaneously select multiple designs via an infill criterion. Still, despite the increased availability of computing resources that enable large-scale parallelism, the strategies that work for selecting a few tens of parallel designs for evaluations become limiting due to the complexity of selecting more designs. It is even more crucial when the black-box is noisy, necessitating more evaluations as well as repeating experiments. Here we propose a scalable strategy that can keep up with massive batching natively, focused on the exploration/exploitation trade-off and a portfolio allocation. We compare the approach with related methods on noisy functions, for mono and multi-objective optimization tasks. These experiments show orders of magnitude speed improvements over existing methods with similar or better performance.

📄 PDF Abstract BibTeX arXiv:2110.09334

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationMultiobjective Optimization

Similar Papers 제목 키워드 기반

Bayesian Word Alignment for Massively Parallel Texts

2014-04-01 · EACL 2014 4 · Robert {\"O}stling
Machine TranslationWord AlignmentWord Sense Disambiguation

Vector operations for accelerating expensive Bayesian computations -- a tutorial guide

2019-02-25 · David J. Warne, Scott A. Sisson, Christopher Drovandi

Many applications in Bayesian statistics are extremely computationally intensive. However, they are often inherently parallel, making them prime targets for modern massively parallel processors. Multi-core and distribute…

Distributed Computing

aphBO-2GP-3B: A budgeted asynchronous parallel multi-acquisition functions for constrained Bayesian optimization on high-performing computing architecture

2020-03-20 · Anh Tran, Mike Eldred, Tim Wildey, Scott McCann 외

High-fidelity complex engineering simulations are highly predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled throu…

Bayesian OptimizationGaussian Processes

Scalable Bayesian Optimization Using Deep Neural Networks

2015-02-19 · Jasper Snoek, Oren Rippel, Kevin Swersky, Ryan Kiros 외

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An…

Bayesian OptimizationCaption GenerationGaussian Processesglobal-optimization+3

Bayesian Portfolio Optimization by Predictive Synthesis

2025-10-08 · Masahiro Kato, Kentaro Baba, Hibiki Kaibuchi, Ryo Inokuchi arxiv

Portfolio optimization is a critical task in investment. Most existing portfolio optimization methods require information on the distribution of returns of the assets that make up the portfolio. However, such distributio…

Portfolio Optimization