paper-with-me

Papers

Adaptive Expansion Bayesian Optimization for Unbounded Global Optimization

2020-01-12 · Wei Chen, Mark Fuge

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will include the true global optimum. We propose a Bayesian optimization approach that only needs to specify an initial search space that does not necessarily include the global optimum, and expands the search space when necessary. However, over-exploration may occur during the search space expansion. Our method can adaptively balance exploration and exploitation in an expanding space. Results on a range of synthetic test functions and an MLP hyperparameter optimization task show that the proposed method out-performs or at least as good as the current state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2001.04815

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimizationglobal-optimizationHyperparameter Optimization

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Bayesian Adaptive Polynomial Chaos Expansions

2025-10-28 · Kellin N. Rumsey, Devin Francom, Graham C. Gibson, J. Derek Tucker 외 arxiv

Polynomial chaos expansions (PCE) are widely used for uncertainty quantification (UQ) tasks, particularly in the applied mathematics community. However, PCE has received comparatively less attention in the statistics lit…

Unbounded Bayesian Optimization via Regularization

2015-08-14 · Bobak Shahriari, Alexandre Bouchard-Côté, Nando de Freitas

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box…

Bayesian OptimizationBenchmarkingglobal-optimization

Learning-to-Optimize with PAC-Bayesian Guarantees: Theoretical Considerations and Practical Implementation

2024-04-04 · Michael Sucker, Jalal Fadili, Peter Ochs

We use the PAC-Bayesian theory for the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-Bayesian …

Maximum a Posteriori Estimation for Linear Structural Dynamics Models Using Bayesian Optimization with Rational Polynomial Chaos Expansions

2024-08-07 · Felix Schneider, Iason Papaioannou, Bruno Sudret, Gerhard Müller

Bayesian analysis enables combining prior knowledge with measurement data to learn model parameters. Commonly, one resorts to computing the maximum a posteriori (MAP) estimate, when only a point estimate of the parameter…

Bayesian OptimizationExperimental Design

Bayesian Optimization with Unknown Search Space

2019-10-29 · NeurIPS 2019 12 · Huong Ha, Santu Rana, Sunil Gupta, Thanh Nguyen 외

Applying Bayesian optimization in problems wherein the search space is unknown is challenging. To address this problem, we propose a systematic volume expansion strategy for the Bayesian optimization. We devise a strateg…

Bayesian Optimization