HiBO: Hierarchical Bayesian Optimization via Adaptive Search Space Partitioning
Optimizing black-box functions in high-dimensional search spaces has been known to be challenging for traditional Bayesian Optimization (BO). In this paper, we introduce HiBO, a novel hierarchical algorithm integrating global-level search space partitioning information into the acquisition strategy of a local BO-based optimizer. HiBO employs a search-tree-based global-level navigator to adaptively split the search space into partitions with different sampling potential. The local optimizer then utilizes this global-level information to guide its acquisition strategy towards most promising regions within the search space. A comprehensive set of evaluations demonstrates that HiBO outperforms state-of-the-art methods in high-dimensional synthetic benchmarks and presents significant practical effectiveness in the real-world task of tuning configurations of database management systems (DBMSs).
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationManagementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Hibou: A Family of Foundational Vision Transformers for Pathology
Pathology, the microscopic examination of diseased tissue, is critical for diagnosing various medical conditions, particularly cancers. Traditional methods are labor-intensive and prone to human error. Digital pathology,…
Diagnosticwhole slide imagesHIBOU: an eBook to improve Text Comprehension and Reading Fluency for Beginning Readers of French
In this paper, we present HIBOU, an eBook application initially developed for iOs, displaying adapted texts (i.e. simplified), and proposing text comprehension activities. The application has been used in six elementary …
Reading ComprehensionIndirect Query Bayesian Optimization with Integrated Feedback
We develop the framework of Indirect Query Bayesian Optimization (IQBO), a new class of Bayesian optimization problems where the integrated feedback is given via a conditional expectation of the unknown function $f$ to b…
Bayesian OptimizationComputational EfficiencyThe Hierarchical Adaptive Forgetting Variational Filter
A common problem in Machine Learning and statistics consists in detecting whether the current sample in a stream of data belongs to the same distribution as previous ones, is an isolated outlier or inaugurates a new dist…
Reinforcement LearningReinforcement Learning (RL)Adaptive Expansion Bayesian Optimization for Unbounded Global Optimization
Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any …
Bayesian Optimizationglobal-optimizationHyperparameter Optimization