paper-with-me

홈 › Papers

Neural Expectation Maximization

2017-08-11 · NeurIPS 2017 12 · Klaus Greff, Sjoerd van Steenkiste, Jürgen Schmidhuber

Many real world tasks such as reasoning and physical interaction require identification and manipulation of conceptual entities. A first step towards solving these tasks is the automated discovery of distributed symbol-like representations. In this paper, we explicitly formalize this problem as inference in a spatial mixture model where each component is parametrized by a neural network. Based on the Expectation Maximization framework we then derive a differentiable clustering method that simultaneously learns how to group and represent individual entities. We evaluate our method on the (sequential) perceptual grouping task and find that it is able to accurately recover the constituent objects. We demonstrate that the learned representations are useful for next-step prediction.

📄 PDF Abstract BibTeX arXiv:1708.03498

Code (1)

sjoerdvansteenkiste/Neural-EM 공식 구현 tf

Tasks

Clustering

Similar Papers 제목 키워드 기반

An Improved EM algorithm

2013-05-03 · Fu-qiang Chen

In this paper, we firstly give a brief introduction of expectation maximization (EM) algorithm, and then discuss the initial value sensitivity of expectation maximization algorithm. Subsequently, we give a short proof of…

Sensitivity

Noisy Expectation-Maximization: Applications and Generalizations

2018-01-12 · Osonde Osoba, Bart Kosko

We present a noise-injected version of the Expectation-Maximization (EM) algorithm: the Noisy Expectation Maximization (NEM) algorithm. The NEM algorithm uses noise to speed up the convergence of the EM algorithm. The NE…

Deterministic Quantum Annealing Expectation-Maximization Algorithm

2017-04-19 · Hideyuki Miyahara, Koji Tsumura, Yuki Sughiyama

Maximum likelihood estimation (MLE) is one of the most important methods in machine learning, and the expectation-maximization (EM) algorithm is often used to obtain maximum likelihood estimates. However, EM heavily depe…

Relaxation of the EM Algorithm via Quantum Annealing for Gaussian Mixture Models

2017-01-12 · Hideyuki Miyahara, Koji Tsumura, Yuki Sughiyama

We propose a modified expectation-maximization algorithm by introducing the concept of quantum annealing, which we call the deterministic quantum annealing expectation-maximization (DQAEM) algorithm. The expectation-maxi…

Density Operator Expectation Maximization

2025-07-30 · Adit Vishnu, Abhay Shastry, Dhruva Kashyap, Chiranjib Bhattacharyya arxiv

Machine learning with density operators, the mathematical foundation of quantum mechanics, is gaining prominence with rapid advances in quantum computing. Generative models based on density operators cannot yet handle ta…