Practical Bayesian Optimization with Threshold-Guided Marginal Likelihood Maximization
We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization consumes a large portion of its execution time in finding the optimal free parameters for Gaussian process regression, our simple, but straightforward method is able to mitigate the time complexity and speed up the overall Bayesian optimization procedure. Finally, the experimental results show that our method is effective to reduce the execution time in most of cases, with less loss of optimization quality.
Code (1)
Tasks
Bayesian OptimizationModel SelectionregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Constraint-Bound Agnostic Bayesian Optimization: One Model for All Thresholds
Expensive constrained optimization problems in real-world industry design often involve constraint thresholds that are difficult to determine in advance. Engineers may need to adjust constraint thresholds to explore diff…
Estimating Real Log Canonical Thresholds
Evaluation of the marginal likelihood plays an important role in model selection problems. The widely applicable Bayesian information criterion (WBIC) and singular Bayesian information criterion (sBIC) give approximation…
Model SelectionThe Case for Bayesian Deep Learning
The key distinguishing property of a Bayesian approach is marginalization instead of optimization, not the prior, or Bayes rule. Bayesian inference is especially compelling for deep neural networks. (1) Neural networks a…
Bayesian InferenceDeep LearningDiversityJoint Model and Data Sparsification via the Marginal Likelihood
Sparse recovery in linear systems underpins applications from signal processing to high-dimensional regression. Sparse Bayesian Learning, grounded in the principle of automatic relevance determination (ARD), offers a pra…
Active Learning of Linear Embeddings for Gaussian Processes
We propose an active learning method for discovering low-dimensional structure in high-dimensional Gaussian process (GP) tasks. Such problems are increasingly frequent and important, but have hitherto presented severe pr…
Active LearningBayesian OptimizationGaussian Processesregression