paper-with-me

Papers

Consistency issues in Gaussian Mixture Models reduction algorithms

2021-04-26 · A. D'Ortenzio, C. Manes

In many contexts Gaussian Mixtures (GM) are used to approximate probability distributions, possibly time-varying. In some applications the number of GM components exponentially increases over time, and reduction procedures are required to keep them reasonably limited. The GM reduction (GMR) problem can be formulated by choosing different measures of the dissimilarity of GMs before and after reduction, like the Kullback-Leibler Divergence (KLD) and the Integral Squared Error (ISE). Since in no case the solution is obtained in closed form, many approximate GMR algorithms have been proposed in the past three decades, although none of them provides optimality guarantees. In this work we discuss the importance of the choice of the dissimilarity measure and the issue of consistency of all steps of a reduction algorithm with the chosen measure. Indeed, most of the existing GMR algorithms are composed by several steps which are not consistent with a unique measure, and for this reason may produce reduced GMs far from optimality. In particular, the use of the KLD, of the ISE and normalized ISE is discussed and compared in this perspective.

📄 PDF Abstract BibTeX arXiv:2104.12586

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Dimension Reduction via Sum-of-Squares and Improved Clustering Algorithms for Non-Spherical Mixtures

2024-11-19 · Prashanti Anderson, Mitali Bafna, Rares-Darius Buhai, Pravesh K. Kothari 외

We develop a new approach for clustering non-spherical (i.e., arbitrary component covariances) Gaussian mixture models via a subroutine, based on the sum-of-squares method, that finds a low-dimensional separation-preserv…

ClusteringDimensionality Reduction

A New Probabilistic Distance Metric With Application In Gaussian Mixture Reduction

2023-06-12 · Ahmad Sajedi, Yuri A. Lawryshyn, Konstantinos N. Plataniotis

This paper presents a new distance metric to compare two continuous probability density functions. The main advantage of this metric is that, unlike other statistical measurements, it can provide an analytic, closed-form…

Density Estimation

Training Gaussian Mixture Models at Scale via Coresets

2017-03-23 · Mario Lucic, Matthew Faulkner, Andreas Krause, Dan Feldman

How can we train a statistical mixture model on a massive data set? In this work we show how to construct coresets for mixtures of Gaussians. A coreset is a weighted subset of the data, which guarantees that models fitti…

Variational Mixture of Gaussian Process Experts

2008-12-01 · NeurIPS 2008 12 · Chao Yuan, Claus Neubauer

Mixture of Gaussian processes models extended a single Gaussian process with ability of modeling multi-modal data and reduction of training complexity. Previous inference algorithms for these models are mostly based on G…

Gaussian ProcessesMixture-of-Experts

Exact Consistency Tests for Gaussian Mixture Filters using Normalized Deviation Squared Statistics

2023-12-29 · Nisar Ahmed, Luke Burks, Kailah Cabral, Alyssa Bekai Rose

We consider the problem of evaluating dynamic consistency in discrete time probabilistic filters that approximate stochastic system state densities with Gaussian mixtures. Dynamic consistency means that the estimated pro…