Dynamic Pruning of Factor Graphs for Maximum Marginal Prediction
We study the problem of maximum marginal prediction (MMP) in probabilistic graphical models, a task that occurs, for example, as the Bayes optimal decision rule under a Hamming loss. MMP is typically performed as a two-stage procedure: one estimates each variable's marginal probability and then forms a prediction from the states of maximal probability. In this work we propose a simple yet effective technique for accelerating MMP when inference is sampling-based: instead of the above two-stage procedure we directly estimate the posterior probability of each decision variable. This allows us to identify the point of time when we are sufficiently certain about any individual decision. Whenever this is the case, we dynamically prune the variable we are confident about from the underlying factor graph. Consequently, at any time only samples of variable whose decision is still uncertain need to be created. Experiments in two prototypical scenarios, multi-label classification and image inpainting, shows that adaptive sampling can drastically accelerate MMP without sacrificing prediction accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Image InpaintingMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPredictionSimilar Papers 제목 키워드 기반
Variable Elimination in Hybrid Factor Graphs for Discrete-Continuous Inference & Estimation
Many problems in robotics involve both continuous and discrete components, and modeling them together for estimation tasks has been a long standing and difficult problem. Hybrid Factor Graphs give us a mathematical frame…
Selecting Samples on Graphs: A Unified Dataset Pruning Framework for Lossless Training Acceleration
The rapid growth of modern training datasets has significantly increased computational cost, motivating dataset pruning~(DP) methods which retain only a subset of informative samples to reduce training cost. Existing pru…
Information Lattice Learning as Probabilistic Graphical Model Structure Learning
Information lattice learning (ILL) learns interpretable rules of a signal by alternately projecting the signal onto a partition lattice that encodes a hierarchy of abstractions and lifting selected rules back to the sign…
General Pruning Criteria for Fast SBL
Sparse Bayesian learning (SBL) associates to each weight in the underlying linear model a hyperparameter by assuming that each weight is Gaussian distributed with zero mean and precision (inverse variance) equal to its a…
Maximum Spectral Measures of Risk with given Risk Factor Marginal Distributions
We consider the problem of determining an upper bound for the value of a spectral risk measure of a loss that is a general nonlinear function of two factors whose marginal distributions are known, but whose joint distrib…