paper-with-me

Papers

DT-PBO: an Interpretable Tree-based Surrogate Model for Preferential Bayesian Optimization

2025-12-16 · Nick Leenders, Thomas Quadt, Boris Cule, Roy Lindelauf, Herman Monsuur, Joost van Oijen, Mark Voskuijl arxiv

Preferential Bayesian Optimization (PBO) aims to find a decision-maker's most preferred solution in as few pairwise comparisons as possible. Existing approaches rely on Gaussian Process (GP) surrogates, which provide strong performance but limited interpretability. This limits real-world usability in high-stakes domains, such as healthcare, where interpretability and trust are essential. We propose DT-PBO, a novel tree-based surrogate model for PBO that is inherently interpretable while capturing preference uncertainty. Specifically, we introduce a novel splitting heuristic that constructs interpretable shallow decision trees directly from pairwise comparison data, and use Laplace approximation to obtain probabilistic estimates for each leaf. This enables efficient preference modeling without sacrificing interpretability. Across eight benchmark functions, our method achieves competitive convergence to GP-based PBO, particularly on functions with rugged optimization landscapes. Additional experiments show robustness against noise and a fast computational running time. Experiments on real-world datasets further demonstrate that our model provides interpretable insights into decision-maker preferences that would remain opaque under GP-based approaches.

📄 PDF Abstract BibTeX arXiv:2512.14263

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties

2024-02-27 · Arun Kumar A V, Alistair Shilton, Sunil Gupta, Santu Rana 외

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design proce…

Bayesian OptimizationExperimental Design

PABBO: Preferential Amortized Black-Box Optimization

2025-03-02 · Xinyu Zhang, Daolang Huang, Samuel Kaski, Julien Martinelli

Preferential Bayesian Optimization (PBO) is a sample-efficient method to learn latent user utilities from preferential feedback over a pair of designs. It relies on a statistical surrogate model for the latent function, …

Bayesian OptimizationMeta-Learning

Top-$k$ Ranking Bayesian Optimization

2020-12-19 · Quoc Phong Nguyen, Sebastian Tay, Bryan Kian Hsiang Low, Patrick Jaillet

This paper presents a novel approach to top-$k$ ranking Bayesian optimization (top-$k$ ranking BO) which is a practical and significant generalization of preferential BO to handle top-$k$ ranking and tie/indifference obs…

Bayesian Optimization

BARK: A Fully Bayesian Tree Kernel for Black-box Optimization

2025-03-07 · Toby Boyne, Jose Pablo Folch, Robert M Lee, Behrang Shafei 외

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and …

Bayesian OptimizationGaussian Processesglobal-optimizationUncertainty Quantification

Efficient Controller Learning from Human Preferences and Numerical Data Via Multi-Modal Surrogate Models

2026-03-25 · Lukas Theiner, Maik Pfefferkorn, Yongpeng Zhao, Sebastian Hirt 외 arxiv

Tuning control policies manually to meet high-level objectives is often time-consuming. Bayesian optimization provides a data-efficient framework for automating this process using numerical evaluations of an objective fu…