Analysis of a Generalized Expectation-Maximization Algorithm for Gaussian Mixture Models: A Control Systems Perspective

2019-03-03 · Sarthak Chatterjee, Orlando Romero, Sérgio Pequito

The Expectation-Maximization (EM) algorithm is one of the most popular methods used to solve the problem of parametric distribution-based clustering in unsupervised learning. In this paper, we propose to analyze a generalized EM (GEM) algorithm in the context of Gaussian mixture models, where the maximization step in the EM is replaced by an increasing step. We show that this GEM algorithm can be understood as a linear time-invariant (LTI) system with a feedback nonlinearity. Therefore, we explore some of its convergence properties by leveraging tools from robust control theory. Lastly, we explain how the proposed GEM can be designed, and present a pedagogical example to understand the advantages of the proposed approach.

📄 PDF Abstract BibTeX arXiv:1903.00979

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Noisy Expectation-Maximization: Applications and Generalizations

2018-01-12 · Osonde Osoba, Bart Kosko

We present a noise-injected version of the Expectation-Maximization (EM) algorithm: the Noisy Expectation Maximization (NEM) algorithm. The NEM algorithm uses noise to speed up the convergence of the EM algorithm. The NE…

Global analysis of Expectation Maximization for mixtures of two Gaussians

2016-08-26 · NeurIPS 2016 12 · Ji Xu, Daniel Hsu, Arian Maleki

Expectation Maximization (EM) is among the most popular algorithms for estimating parameters of statistical models. However, EM, which is an iterative algorithm based on the maximum likelihood principle, is generally onl…

Vocal Bursts Valence Prediction

Stochastic Expectation Maximization with Variance Reduction

2018-12-01 · NeurIPS 2018 12 · Jianfei Chen, Jun Zhu, Yee Whye Teh, Tong Zhang

Expectation-Maximization (EM) is a popular tool for learning latent variable models, but the vanilla batch EM does not scale to large data sets because the whole data set is needed at every E-step. Stochastic Expectation…

Quantum Expectation-Maximization Algorithm

2019-08-19 · Hideyuki Miyahara, Kazuyuki Aihara, Wolfgang Lechner

Clustering algorithms are a cornerstone of machine learning applications. Recently, a quantum algorithm for clustering based on the k-means algorithm has been proposed by Kerenidis, Landman, Luongo and Prakash. Based on …

BIG-bench Machine Learning Clustering

Generalized Fast Multichannel Nonnegative Matrix Factorization Based on Gaussian Scale Mixtures for Blind Source Separation

2022-05-11 · Mathieu Fontaine, Kouhei Sekiguchi, Aditya Nugraha, Yoshiaki Bando 외

This paper describes heavy-tailed extensions of a state-of-the-art versatile blind source separation method called fast multichannel nonnegative matrix factorization (FastMNMF) from a unified point of view. The common wa…

blind source separation Speech Enhancement