Improving Active Learning with a Bayesian Representation of Epistemic Uncertainty
A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet, distinguishing these two types of uncertainty remains challenging and there is no single strategy that consistently outperforms the others. We propose to use a particular combination of probability and possibility theories, with the aim of using the latter to specifically represent epistemic uncertainty, and we show how this combination leads to new active learning strategies that have desirable properties. In order to demonstrate the efficiency of these strategies in non-trivial settings, we introduce the notion of a possibilistic Gaussian process (GP) and consider GP-based multiclass and binary classification problems, for which the proposed methods display a strong performance for both simulated and real datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningBinary ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Big Batch Bayesian Active Learning by Considering Predictive Probabilities
We observe that BatchBALD, a popular acquisition function for batch Bayesian active learning for classification, can conflate epistemic and aleatoric uncertainty, leading to suboptimal performance. Motivated by this obse…
Active LearningUncertainty Disentanglement with Non-stationary Heteroscedastic Gaussian Processes for Active Learning
Gaussian processes are Bayesian non-parametric models used in many areas. In this work, we propose a Non-stationary Heteroscedastic Gaussian process model which can be learned with gradient-based techniques. We demonstra…
Active LearningDisentanglementGaussian ProcessesEpistemic Uncertainty Quantification For Pre-Trained Neural Networks
Epistemic uncertainty quantification (UQ) identifies where models lack knowledge. Traditional UQ methods often based on Bayesian neural networks are not suitable for pre-trained non-Bayesian models. Our study address…
Active LearningOut-of-Distribution DetectionUncertainty QuantificationEpistemic Uncertainty Quantification For Pre-trained Neural Network
Epistemic uncertainty quantification (UQ) identifies where models lack knowledge. Traditional UQ methods, often based on Bayesian neural networks, are not suitable for pre-trained non-Bayesian models. Our study addresses…
Active LearningOut-of-Distribution DetectionUncertainty QuantificationEfficient Epistemic Uncertainty Estimation in Regression Ensemble Models Using Pairwise-Distance Estimators
This work introduces an efficient novel approach for epistemic uncertainty estimation for ensemble models for regression tasks using pairwise-distance estimators (PaiDEs). Utilizing the pairwise-distance between model co…
Active LearningDecision Makingregression