Towards Bayesian Data Selection
A wide range of machine learning algorithms iteratively add data to the training sample. Examples include semi-supervised learning, active learning, multi-armed bandits, and Bayesian optimization. We embed this kind of data addition into decision theory by framing data selection as a decision problem. This paves the way for finding Bayes-optimal selections of data. For the illustrative case of self-training in semi-supervised learning, we derive the respective Bayes criterion. We further show that deploying this criterion mitigates the issue of confirmation bias by empirically assessing our method for generalized linear models, semi-parametric generalized additive models, and Bayesian neural networks on simulated and real-world data.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningAdditive modelsBayesian OptimizationMulti-Armed BanditsSimilar Papers 제목 키워드 기반
On Bayesian Exponentially Embedded Family for Model Order Selection
In this paper, we derive a Bayesian model order selection rule by using the exponentially embedded family method, termed Bayesian EEF. Unlike many other Bayesian model selection methods, the Bayesian EEF can use vague pr…
Model SelectionPAC-Bayesian Model Selection for Reinforcement Learning
This paper introduces the first set of PAC-Bayesian bounds for the batch reinforcement learning problem in finite state spaces. These bounds hold regardless of the correctness of the prior distribution. We demonstrate ho…
modelModel Selectionreinforcement-learningReinforcement Learning+1Bayesian Model Selection of Lithium-Ion Battery Models via Bayesian Quadrature
A wide variety of battery models are available, and it is not always obvious which model `best' describes a dataset. This paper presents a Bayesian model selection approach using Bayesian quadrature. The model evidence i…
Model SelectionBayesian model selection consistency and oracle inequality with intractable marginal likelihood
In this article, we investigate large sample properties of model selection procedures in a general Bayesian framework when a closed form expression of the marginal likelihood function is not available or a local asymptot…
Gaussian ProcessesModel SelectionregressionBayesian Feature Selection in Joint Quantile Time Series Analysis
Quantile feature selection over correlated multivariate time series data has always been a methodological challenge and is an open problem. In this paper, we propose a general Bayesian dimension reduction methodology for…
Dimensionality Reductionfeature selectionparameter estimationquantile regression+2