BARK: A Fully Bayesian Tree Kernel for Black-box Optimization
We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and we explore the space of tree kernels using a Markov chain Monte Carlo approach. Where BART only samples functions, the resulting BARK model obtains samples of Gaussian processes defining distributions over functions, which allow us to build acquisition functions for Bayesian optimization. Our tree-based approach enables global optimization over the surrogate, even for mixed-feature spaces. Moreover, where many previous tree-based kernels provide uncertainty quantification over function values, our sampling scheme captures uncertainty over the tree structure itself. Our experiments show the strong performance of BARK on both synthetic and applied benchmarks, due to the combination of our fully Bayesian surrogate and the optimization procedure.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationGaussian Processesglobal-optimizationUncertainty QuantificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Tree Species Identification from Bark Images Using Convolutional Neural Networks
Tree species identification using bark images is a challenging problem that could prove useful for many forestry related tasks. However, while the recent progress in deep learning showed impressive results on standard vi…
Deep LearningTree bark re-identification using a deep-learning feature descriptor
The ability to visually re-identify objects is a fundamental capability in vision systems. Oftentimes, it relies on collections of visual signatures based on descriptors, such as SIFT or SURF. However, these traditional …
Deep LearningAutomated Identification of Tree Species by Bark Texture Classification Using Convolutional Neural Networks
Identification of tree species plays a key role in forestry related tasks like forest conservation, disease diagnosis and plant production. There had been a debate regarding the part of the tree to be used for differenti…
Texture ClassificationTransfer LearningTree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spaces
Tree ensembles can be well-suited for black-box optimization tasks such as algorithm tuning and neural architecture search, as they achieve good predictive performance with little or no manual tuning, naturally handle di…
Bayesian OptimizationNeural Architecture SearchExplaining excitable population dynamics in bark beetles: From life history to large, episodic outbreaks
Bark beetles are significant forest pests, with some species capable of causing widespread tree mortality. Among these, the mountain pine beetle (MPB) stands out for its exceptionally destructive outbreak in the 2000s. W…