paper-with-me

홈 › Papers

A Variational Approximations-DIC Rubric for Parameter Estimation and Mixture Model Selection Within a Family Setting

2013-06-23 · Sanjeena Subedi, Paul D. McNicholas

Mixture model-based clustering has become an increasingly popular data analysis technique since its introduction over fifty years ago, and is now commonly utilized within a family setting. Families of mixture models arise when the component parameters, usually the component covariance (or scale) matrices, are decomposed and a number of constraints are imposed. Within the family setting, model selection involves choosing the member of the family, i.e., the appropriate covariance structure, in addition to the number of mixture components. To date, the Bayesian information criterion (BIC) has proved most effective for model selection, and the expectation-maximization (EM) algorithm is usually used for parameter estimation. In fact, this EM-BIC rubric has virtually monopolized the literature on families of mixture models. Deviating from this rubric, variational Bayes approximations are developed for parameter estimation and the deviance information criterion for model selection. The variational Bayes approach provides an alternate framework for parameter estimation by constructing a tight lower bound on the complex marginal likelihood and maximizing this lower bound by minimizing the associated Kullback-Leibler divergence. This approach is taken on the most commonly used family of Gaussian mixture models, and real and simulated data are used to compare the new approach to the EM-BIC rubric.

📄 PDF Abstract BibTeX arXiv:1306.5368

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringModel Selectionparameter estimation

Similar Papers 제목 키워드 기반

Variational Bayes Approximations for Clustering via Mixtures of Normal Inverse Gaussian Distributions

2013-09-07 · Sanjeena Subedi, Paul D. McNicholas

Parameter estimation for model-based clustering using a finite mixture of normal inverse Gaussian (NIG) distributions is achieved through variational Bayes approximations. Univariate NIG mixtures and multivariate NIG mix…

Clusteringparameter estimation

Efficient Gradient-Free Variational Inference using Policy Search

2018-07-01 · ICML 2018 7 · Oleg Arenz, Gerhard Neumann, Mingjun Zhong

Inference from complex distributions is a common problem in machine learning needed for many Bayesian methods. We propose an efficient, gradient-free method for learning general GMM approximations of multimodal dist…

Efficient ExplorationVariational Inference

Variational Gaussian filtering via Wasserstein gradient flows

2023-03-11 · Adrien Corenflos, Hany Abdulsamad

We present a novel approach to approximate Gaussian and mixture-of-Gaussians filtering. Our method relies on a variational approximation via a gradient-flow representation. The gradient flow is derived from a Kullback--L…

parameter estimationState Space Models

Improved Variational Bayesian Phylogenetic Inference using Mixtures

2023-10-02 · Oskar Kviman, Ricky Molén, Jens Lagergren

We present VBPI-Mixtures, an algorithm designed to enhance the accuracy of phylogenetic posterior distributions, particularly for tree-topology and branch-length approximations. Despite the Variational Bayesian Phylogene…

Density EstimationVariational Inference

Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations

2019-06-07 · Wu Lin, Mohammad Emtiyaz Khan, Mark Schmidt

Natural-gradient methods enable fast and simple algorithms for variational inference, but due to computational difficulties, their use is mostly limited to \emph{minimal} exponential-family (EF) approximations. In this p…

Bayesian InferenceVariational Inference