paper-with-me

홈 › Papers

Sinkhorn EM: An Expectation-Maximization algorithm based on entropic optimal transport

2020-06-30 · Gonzalo Mena, Amin Nejatbakhsh, Erdem Varol, Jonathan Niles-Weed

We study Sinkhorn EM (sEM), a variant of the expectation maximization (EM) algorithm for mixtures based on entropic optimal transport. sEM differs from the classic EM algorithm in the way responsibilities are computed during the expectation step: rather than assign data points to clusters independently, sEM uses optimal transport to compute responsibilities by incorporating prior information about mixing weights. Like EM, sEM has a natural interpretation as a coordinate ascent procedure, which iteratively constructs and optimizes a lower bound on the log-likelihood. However, we show theoretically and empirically that sEM has better behavior than EM: it possesses better global convergence guarantees and is less prone to getting stuck in bad local optima. We complement these findings with experiments on simulated data as well as in an inference task involving C. elegans neurons and show that sEM learns cell labels significantly better than other approaches.

📄 PDF Abstract BibTeX arXiv:2006.16548

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

EMS Coreset: An Efficient Expectation-Maximization Algorithm for Sinkhorn Coreset

2026-08-17 · Haoyun Yin, Chuanhui Liu, Xiao Wang arxiv

Coresets distill large datasets into small, representative subsets for efficient downstream learning. Yet Optimal Transport (OT)-based selection typically requires intensive computation of transport plans, limiting scala…

Mirror Descent with Relative Smoothness in Measure Spaces, with application to Sinkhorn and EM

2022-06-17 · Pierre-Cyril Aubin-Frankowski, Anna Korba, Flavien Léger

Many problems in machine learning can be formulated as optimizing a convex functional over a vector space of measures. This paper studies the convergence of the mirror descent algorithm in this infinite-dimensional setti…

On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithm

2020-02-09 · ICML 2020 1 · Khiem Pham, Khang Le, Nhat Ho, Tung Pham 외

We provide a computational complexity analysis for the Sinkhorn algorithm that solves the entropic regularized Unbalanced Optimal Transport (UOT) problem between two measures of possibly different masses with at most $n$…

A Sinkhorn-type Algorithm for Constrained Optimal Transport

2024-03-08 · Xun Tang, Holakou Rahmanian, Michael Shavlovsky, Kiran Koshy Thekumparampil 외

Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In…

Scheduling

Gaussian entropic optimal transport: Schrödinger bridges and the Sinkhorn algorithm

2024-12-24 · O. Deniz Akyildiz, Pierre Del Moral, Joaquín Miguez

Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems…