paper-with-me

홈 › Papers

Bayesian Active Learning for Classification and Preference Learning

2011-12-24 · Neil Houlsby, Ferenc Huszár, Zoubin Ghahramani, Máté Lengyel

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with nonparametric models, the optimal solution is harder to compute. Current approaches make approximations to achieve tractability. We propose an approach that expresses information gain in terms of predictive entropies, and apply this method to the Gaussian Process Classifier (GPC). Our approach makes minimal approximations to the full information theoretic objective. Our experimental performance compares favourably to many popular active learning algorithms, and has equal or lower computational complexity. We compare well to decision theoretic approaches also, which are privy to more information and require much more computational time. Secondly, by developing further a reformulation of binary preference learning to a classification problem, we extend our algorithm to Gaussian Process preference learning.

📄 PDF Abstract BibTeX arXiv:1112.5745

Code (2)

airi-institute/al_toolbox pytorch
cambridge-mlg/BALaudiogram

Tasks

Active LearningClassificationGeneral Classification

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Active Preference Learning over Latent Preference Archetypes for Many-Objective Bayesian Optimization

2026-03-30 · Manisha Dubey, Sebastiaan De Peuter, Wanrong Wang, Samuel Kaski arxiv

Preference-based many-objective Bayesian optimization typically assumes that all pairwise comparisons arise from a single latent utility function, despite real decision makers often exhibiting multiple latent preference …

Deep Bayesian Active Learning for Preference Modeling in Large Language Models

2024-06-14 · Luckeciano C. Melo, Panagiotis Tigas, Alessandro Abate, Yarin Gal

Leveraging human preferences for steering the behavior of Large Language Models (LLMs) has demonstrated notable success in recent years. Nonetheless, data selection and labeling are still a bottleneck for these systems, …

Active Learning

Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomes

2022-03-21 · Zhiyuan Jerry Lin, Raul Astudillo, Peter I. Frazier, Eytan Bakshy

We consider Bayesian optimization of expensive-to-evaluate experiments that generate vector-valued outcomes over which a decision-maker (DM) has preferences. These preferences are encoded by a utility function that is no…

Bayesian Optimization

Finding Convincing Arguments Using Scalable Bayesian Preference Learning

2018-06-06 · TACL 2018 1 · Edwin Simpson, Iryna Gurevych

We introduce a scalable Bayesian preference learning method for identifying convincing arguments in the absence of gold-standard rat- ings or rankings. In contrast to previous work, we avoid the need for separate methods…

Active LearningVariational InferenceWord Embeddings

Multi-Objective Bayesian Optimization with Active Preference Learning

2023-11-22 · Ryota Ozaki, Kazuki Ishikawa, Youhei Kanzaki, Shinya Suzuki 외

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires …

Active LearningBayesian Optimization