paper-with-me

홈 › Papers

Optimistic Games for Combinatorial Bayesian Optimization with Application to Protein Design

2024-09-27 · Melis Ilayda Bal, Pier Giuseppe Sessa, Mojmir Mutny, Andreas Krause

Bayesian optimization (BO) is a powerful framework to optimize black-box expensive-to-evaluate functions via sequential interactions. In several important problems (e.g. drug discovery, circuit design, neural architecture search, etc.), though, such functions are defined over large $\textit{combinatorial and unstructured}$ spaces. This makes existing BO algorithms not feasible due to the intractable maximization of the acquisition function over these domains. To address this issue, we propose $\textbf{GameOpt}$, a novel game-theoretical approach to combinatorial BO. $\textbf{GameOpt}$ establishes a cooperative game between the different optimization variables, and selects points that are game $\textit{equilibria}$ of an upper confidence bound acquisition function. These are stable configurations from which no variable has an incentive to deviate$-$ analog to local optima in continuous domains. Crucially, this allows us to efficiently break down the complexity of the combinatorial domain into individual decision sets, making $\textbf{GameOpt}$ scalable to large combinatorial spaces. We demonstrate the application of $\textbf{GameOpt}$ to the challenging $\textit{protein design}$ problem and validate its performance on four real-world protein datasets. Each protein can take up to $20^{X}$ possible configurations, where $X$ is the length of a protein, making standard BO methods infeasible. Instead, our approach iteratively selects informative protein configurations and very quickly discovers highly active protein variants compared to other baselines.

📄 PDF Abstract BibTeX arXiv:2409.18582

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDrug DiscoveryNeural Architecture SearchProtein Design

Similar Papers 제목 키워드 기반

Computing the Strategy to Commit to in Polymatrix Games (Extended Version)

2018-07-31 · Giuseppe De Nittis, Alberto Marchesi, Nicola Gatti

Leadership games provide a powerful paradigm to model many real-world settings. Most literature focuses on games with a single follower who acts optimistically, breaking ties in favour of the leader. Unfortunately, for r…

Variational Bayesian Optimistic Sampling

2021-10-29 · NeurIPS 2021 12 · Brendan O'Donoghue, Tor Lattimore

We consider online sequential decision problems where an agent must balance exploration and exploitation. We derive a set of Bayesian `optimistic' policies which, in the stochastic multi-armed bandit case, includes the T…

Thompson Sampling

Optimistic Online Learning in Symmetric Cone Games

2025-04-04 · Anas Barakat, Wayne Lin, John Lazarsfeld, Antonios Varvitsiotis

Optimistic online learning algorithms have led to significant advances in equilibrium computation, particularly for two-player zero-sum games, achieving an iteration complexity of $\mathcal{O}(1/\epsilon)$ to reach an $\…

Metric Learning

Optimistic Optimization of Gaussian Process Samples

2022-09-02 · Julia Grosse, Cheng Zhang, Philipp Hennig

Bayesian optimization is a popular formalism for global optimization, but its computational costs limit it to expensive-to-evaluate functions. A competing, computationally more efficient, global optimization framework is…

Bayesian OptimizationComputational Efficiencyglobal-optimization

Towards convergence to Nash equilibria in two-team zero-sum games

2021-11-07 · Fivos Kalogiannis, Ioannis Panageas, Emmanouil-Vasileios Vlatakis-Gkaragkounis

Contemporary applications of machine learning in two-team e-sports and the superior expressivity of multi-agent generative adversarial networks raise important and overlooked theoretical questions regarding optimization …

Vocal Bursts Valence Prediction