paper-with-me

홈 › Papers

Parallel and Distributed Thompson Sampling for Large-scale Accelerated Exploration of Chemical Space

2017-06-06 · ICML 2017 8 · José Miguel Hernández-Lobato, James Requeima, Edward O. Pyzer-Knapp, Alán Aspuru-Guzik

Chemical space is so large that brute force searches for new interesting molecules are infeasible. High-throughput virtual screening via computer cluster simulations can speed up the discovery process by collecting very large amounts of data in parallel, e.g., up to hundreds or thousands of parallel measurements. Bayesian optimization (BO) can produce additional acceleration by sequentially identifying the most useful simulations or experiments to be performed next. However, current BO methods cannot scale to the large numbers of parallel measurements and the massive libraries of molecules currently used in high-throughput screening. Here, we propose a scalable solution based on a parallel and distributed implementation of Thompson sampling (PDTS). We show that, in small scale problems, PDTS performs similarly as parallel expected improvement (EI), a batch version of the most widely used BO heuristic. Additionally, in settings where parallel EI does not scale, PDTS outperforms other scalable baselines such as a greedy search, $\epsilon$-greedy approaches and a random search method. These results show that PDTS is a successful solution for large-scale parallel BO.

📄 PDF Abstract BibTeX arXiv:1706.01825

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationThompson Sampling

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Random Search Random Search replaces the exhaustive enumeration of all combinations by selecting them randomly. This can be simply applied to the discrete setting described above, but also…

Similar Papers 제목 키워드 기반

Asynchronous Parallel Bayesian Optimisation via Thompson Sampling

2017-05-25 · Kirthevasan Kandasamy, Akshay Krishnamurthy, Jeff Schneider, Barnabas Poczos

We design and analyse variations of the classical Thompson sampling (TS) procedure for Bayesian optimisation (BO) in settings where function evaluations are expensive, but can be performed in parallel. Our theoretical an…

Bayesian OptimisationThompson Sampling

Distributed Thompson Sampling

2020-12-03 · Jing Dong, Tan Li, Shaolei Ren, Linqi Song

We study a cooperative multi-agent multi-armed bandits with M agents and K arms. The goal of the agents is to minimized the cumulative regret. We adapt a traditional Thompson Sampling algoirthm under the distributed sett…

Multi-Armed BanditsThompson Sampling

Fully Distributed Bayesian Optimization with Stochastic Policies

2019-02-26 · Javier Garcia-Barcos, Ruben Martinez-Cantin

Bayesian optimization has become a popular method for high-throughput computing, like the design of computer experiments or hyperparameter tuning of expensive models, where sample efficiency is mandatory. In these applic…

Bayesian OptimizationThompson Sampling

A Distributed Neural Linear Thompson Sampling Framework to Achieve URLLC in Industrial IoT

2023-11-21 · Francesco Pase, Marco Giordani, Sara Cavallero, Malte Schellmann 외

Industrial Internet of Things (IIoT) networks will provide Ultra-Reliable Low-Latency Communication (URLLC) to support critical processes underlying the production chains. However, standard protocols for allocating wirel…

SchedulingThompson Sampling

Sampling Acquisition Functions for Batch Bayesian Optimization

2019-03-22 · Alessandro De Palma, Celestine Mendler-Dünner, Thomas Parnell, Andreea Anghel 외

We present Acquisition Thompson Sampling (ATS), a novel technique for batch Bayesian Optimization (BO) based on the idea of sampling multiple acquisition functions from a stochastic process. We define this process throug…

Bayesian OptimizationThompson Sampling