paper-with-me

홈 › Papers

SCORE: A 1D Reparameterization Technique to Break Bayesian Optimization's Curse of Dimensionality

2024-06-18 · Joseph Chakar

Bayesian optimization (BO) has emerged as a powerful tool for navigating complex search spaces, showcasing practical applications in the fields of science and engineering.However, since it typically relies on a surrogate model to approximate the objective function, BO grapples with heightened computational costs that tend to escalate as the number of parameters and experiments grows. Several methods such as parallelization, surrogate model approximations, and memory pruning have been proposed to cut down computing time, but they all fall short of resolving the core issue behind BO's curse of dimensionality. In this paper, a 1D reparametrization trick is proposed to break this curse and sustain linear time complexity for BO in high-dimensional landscapes. This fast and scalable approach named SCORE can successfully find the global minimum of needle-in-a-haystack optimization functions and fit real-world data without the high-performance computing resources typically required by state-of-the-art techniques.

📄 PDF Abstract BibTeX arXiv:2406.12661

Code (1)

hi-paris/SCORE 공식 구현

Tasks

Bayesian Optimization

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Reparameterization invariance in approximate Bayesian inference

2024-06-05 · Hrittik Roy, Marco Miani, Carl Henrik Ek, Philipp Hennig 외

Current approximate posteriors in Bayesian neural networks (BNNs) exhibit a crucial limitation: they fail to maintain invariance under reparameterization, i.e. BNNs assign different posterior densities to different param…

Bayesian Inference

Automated design of nonreciprocal thermal emitters via Bayesian optimization

2024-09-13 · Bach Do, Sina Jafari Ghalekohneh, Taiwo Adebiyi, Bo Zhao 외

Nonreciprocal thermal emitters that break Kirchhoff's law of thermal radiation promise exciting applications for thermal and energy applications. The design of the bandwidth and angular range of the nonreciprocal effect,…

Bayesian OptimizationPhysical Intuition

Stochastic Optimal Control Matching

2023-12-04 · Carles Domingo-Enrich, Jiequn Han, Brandon Amos, Joan Bruna 외

Stochastic optimal control, which has the goal of driving the behavior of noisy systems, is broadly applicable in science, engineering and artificial intelligence. Our work introduces Stochastic Optimal Control Matching …

Philosophy

Reparameterization Gradients through Acceptance-Rejection Sampling Algorithms

2016-10-18 · Christian A. Naesseth, Francisco J. R. Ruiz, Scott W. Linderman, David M. Blei

Variational inference using the reparameterization trick has enabled large-scale approximate Bayesian inference in complex probabilistic models, leveraging stochastic optimization to sidestep intractable expectations. Th…

Bayesian InferenceStochastic OptimizationVariational Inference

Reducing Reparameterization Gradient Variance

2017-05-22 · NeurIPS 2017 12 · Andrew C. Miller, Nicholas J. Foti, Alexander D'Amour, Ryan P. Adams

Optimization with noisy gradients has become ubiquitous in statistics and machine learning. Reparameterization gradients, or gradient estimates computed via the "reparameterization trick," represent a class of noisy grad…

Variational Inference