paper-with-me

Papers

Parallel Bayesian Optimization Using Satisficing Thompson Sampling for Time-Sensitive Black-Box Optimization

2023-10-19 · Xiaobin Song, Benben Jiang

Bayesian optimization (BO) is widely used for black-box optimization problems, and have been shown to perform well in various real-world tasks. However, most of the existing BO methods aim to learn the optimal solution, which may become infeasible when the parameter space is extremely large or the problem is time-sensitive. In these contexts, switching to a satisficing solution that requires less information can result in better performance. In this work, we focus on time-sensitive black-box optimization problems and propose satisficing Thompson sampling-based parallel Bayesian optimization (STS-PBO) approaches, including synchronous and asynchronous versions. We shift the target from an optimal solution to a satisficing solution that is easier to learn. The rate-distortion theory is introduced to construct a loss function that balances the amount of information that needs to be learned with sub-optimality, and the Blahut-Arimoto algorithm is adopted to compute the target solution that reaches the minimum information rate under the distortion limit at each step. Both discounted and undiscounted Bayesian cumulative regret bounds are theoretically derived for the proposed STS-PBO approaches. The effectiveness of the proposed methods is demonstrated on a fast-charging design problem of Lithium-ion batteries. The results are accordant with theoretical analyses, and show that our STS-PBO methods outperform both sequential counterparts and parallel BO with traditional Thompson sampling in both synchronous and asynchronous settings.

📄 PDF Abstract BibTeX arXiv:2310.12526

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationSTSThompson Sampling

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Satisficing in Time-Sensitive Bandit Learning

2018-03-07 · Daniel Russo, Benjamin Van Roy

Much of the recent literature on bandit learning focuses on algorithms that aim to converge on an optimal action. One shortcoming is that this orientation does not account for time sensitivity, which can play a crucial r…

Thompson Sampling

Time-Sensitive Bandit Learning and Satisficing Thompson Sampling

2017-04-28 · Daniel Russo, David Tse, Benjamin Van Roy

The literature on bandit learning and regret analysis has focused on contexts where the goal is to converge on an optimal action in a manner that limits exploration costs. One shortcoming imposed by this orientation is t…

Thompson Sampling

Sampling Acquisition Functions for Batch Bayesian Optimization

2019-03-22 · Alessandro De Palma, Celestine Mendler-Dünner, Thomas Parnell, Andreea Anghel 외

We present Acquisition Thompson Sampling (ATS), a novel technique for batch Bayesian Optimization (BO) based on the idea of sampling multiple acquisition functions from a stochastic process. We define this process throug…

Bayesian OptimizationThompson Sampling

Fully Distributed Bayesian Optimization with Stochastic Policies

2019-02-26 · Javier Garcia-Barcos, Ruben Martinez-Cantin

Bayesian optimization has become a popular method for high-throughput computing, like the design of computer experiments or hyperparameter tuning of expensive models, where sample efficiency is mandatory. In these applic…

Bayesian OptimizationThompson Sampling

Parallel Contextual Bandits in Wireless Handover Optimization

2019-01-21 · Igor Colin, Albert Thomas, Moez Draief

As cellular networks become denser, a scalable and dynamic tuning of wireless base station parameters can only be achieved through automated optimization. Although the contextual bandit framework arises as a natural cand…

Multi-Armed BanditsThompson Sampling