paper-with-me

Papers

Gaussian Mixture Reduction Using Reverse Kullback-Leibler Divergence

2015-08-22 · Tohid Ardeshiri, Umut Orguner, Emre Özkan

We propose a greedy mixture reduction algorithm which is capable of pruning mixture components as well as merging them based on the Kullback-Leibler divergence (KLD). The algorithm is distinct from the well-known Runnalls' KLD based method since it is not restricted to merging operations. The capability of pruning (in addition to merging) gives the algorithm the ability of preserving the peaks of the original mixture during the reduction. Analytical approximations are derived to circumvent the computational intractability of the KLD which results in a computationally efficient method. The proposed algorithm is compared with Runnalls' and Williams' methods in two numerical examples, using both simulated and real world data. The results indicate that the performance and computational complexity of the proposed approach make it an efficient alternative to existing mixture reduction methods.

📄 PDF Abstract BibTeX arXiv:1508.05514

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Guaranteed bounds on the Kullback-Leibler divergence of univariate mixtures using piecewise log-sum-exp inequalities

2016-06-19 · Frank Nielsen, Ke Sun

Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks. Since the Kullback-Leibler divergence …

Form

On a generalization of the Jensen-Shannon divergence and the JS-symmetrization of distances relying on abstract means

2019-04-08 · Frank Nielsen

The Jensen-Shannon divergence is a renown bounded symmetrization of the unbounded Kullback-Leibler divergence which measures the total Kullback-Leibler divergence to the average mixture distribution. However the Jensen-S…

ClusteringForm

Variational Inference with Mixtures of Isotropic Gaussians

2025-06-16 · Marguerite Petit-Talamon, Marc Lambert, Anna Korba

Variational inference (VI) is a popular approach in Bayesian inference, that looks for the best approximation of the posterior distribution within a parametric family, minimizing a loss that is typically the (reverse) Ku…

Bayesian InferenceVariational Inference

Learning Multi-Sense Word Distributions using Approximate Kullback-Leibler Divergence

2019-11-12 · P. Jayashree, Ballijepalli Shreya, P. K. Srijith

Learning word representations has garnered greater attention in the recent past due to its diverse text applications. Word embeddings encapsulate the syntactic and semantic regularities of sentences. Modelling word embed…

Word EmbeddingsWord Similarity

Consistency issues in Gaussian Mixture Models reduction algorithms

2021-04-26 · A. D'Ortenzio, C. Manes

In many contexts Gaussian Mixtures (GM) are used to approximate probability distributions, possibly time-varying. In some applications the number of GM components exponentially increases over time, and reduction procedur…