paper-with-me

Papers

Gaussian Mixture Model with unknown diagonal covariances via continuous sparse regularization

2025-09-16 · Romane Giard, Yohann de Castro, Clément Marteau arxiv

This paper addresses the statistical estimation of Gaussian Mixture Models (GMMs) with unknown diagonal covariances from independent and identically distributed samples. We employ the Beurling-LASSO (BLASSO), a convex optimization framework that promotes sparsity in the space of measures, to simultaneously estimate the number of components and their parameters. Our main contribution extends the BLASSO methodology to multivariate GMMs with component-specific unknown diagonal covariance matrices. This setting is significantly more flexible than previous approaches, which required known and identical covariances. We establish non-asymptotic recovery guarantees with nearly parametric convergence rates for component means, diagonal covariances, and weights, as well as for density prediction. A key theoretical contribution is the identification of an explicit separation condition on mixture components that enables the construction of non-degenerate dual certificates-essential tools for establishing statistical guarantees for the BLASSO. Our analysis leverages the Fisher-Rao geometry of the statistical model and introduces a novel semi-distance adapted to our framework, providing new insights into the interplay between component separation, parameter space geometry, and achievable statistical recovery.

📄 PDF Abstract BibTeX arXiv:2509.12889

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

One-Pass Sparsified Gaussian Mixtures

2019-03-10 · Eric Kightley, Stephen Becker

We present a one-pass sparsified Gaussian mixture model (SGMM). Given $N$ data points in $P$ dimensions, $X$, the model fits $K$ Gaussian distributions to $X$ and (softly) classifies each point to these clusters. After p…

Clustering

Learning Mixtures of Linear Regressions with Nearly Optimal Complexity

2018-02-22 · Yuanzhi Li, YIngyu Liang

Mixtures of Linear Regressions (MLR) is an important mixture model with many applications. In this model, each observation is generated from one of the several unknown linear regression components, where the identity of …

Tensor Moments of Gaussian Mixture Models: Theory and Applications

2022-02-14 · João M. Pereira, Joe Kileel, Tamara G. Kolda

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-w…

parameter estimationTensor Decomposition

Learning general Gaussian mixtures with efficient score matching

2024-04-29 · Sitan Chen, Vasilis Kontonis, Kulin Shah

We study the problem of learning mixtures of $k$ Gaussians in $d$ dimensions. We make no separation assumptions on the underlying mixture components: we only require that the covariance matrices have bounded condition nu…

Beyond ICA: Identifiability by Symmetry Breaking

2026-07-25 · Pengzhou Wu arxiv

We prove the identifiability of deep generative models (DGMs) with piecewise-affine (PWA) decoders and Gaussian mixture model (GMM) priors, in a purely unsupervised setting. We introduce three algebraic contrast principl…