paper-with-me

Papers

Algebraic and Analytic Approaches for Parameter Learning in Mixture Models

2020-01-19 · Akshay Krishnamurthy, Arya Mazumdar, Andrew Mcgregor, Soumyabrata Pal

We present two different approaches for parameter learning in several mixture models in one dimension. Our first approach uses complex-analytic methods and applies to Gaussian mixtures with shared variance, binomial mixtures with shared success probability, and Poisson mixtures, among others. An example result is that $\exp(O(N^{1/3}))$ samples suffice to exactly learn a mixture of $k<N$ Poisson distributions, each with integral rate parameters bounded by $N$. Our second approach uses algebraic and combinatorial tools and applies to binomial mixtures with shared trial parameter $N$ and differing success parameters, as well as to mixtures of geometric distributions. Again, as an example, for binomial mixtures with $k$ components and success parameters discretized to resolution $\epsilon$, $O(k^2(N/\epsilon)^{8/\sqrt{\epsilon}})$ samples suffice to exactly recover the parameters. For some of these distributions, our results represent the first guarantees for parameter estimation.

📄 PDF Abstract BibTeX arXiv:2001.06776

Code (0)

등록된 구현이 없습니다.

Tasks

parameter estimation

Similar Papers 제목 키워드 기반

Convergence Rates for Gaussian Mixtures of Experts

2019-07-09 · Nhat Ho, Chiao-Yu Yang, Michael. I. Jordan

We provide a theoretical treatment of over-specified Gaussian mixtures of experts with covariate-free gating networks. We establish the convergence rates of the maximum likelihood estimation (MLE) for these models. Our p…

parameter estimation

Mixtures Closest to a Given Measure: A Semidefinite Programming Approach

2025-09-26 · Srećko Đurašinović, Jean-Bernard Lasserre, Victor Magron arxiv

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order an…

Learning Mixtures of Gaussians Using Diffusion Models

2024-04-29 · Khashayar Gatmiry, Jonathan Kelner, Holden Lee

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$)…

Image Generation

On the identifiability of mixtures of ranking models

2022-01-31 · Xiaomin Zhang, Xucheng Zhang, Po-Ling Loh, YIngyu Liang

Mixtures of ranking models are standard tools for ranking problems. However, even the fundamental question of parameter identifiability is not fully understood: the identifiability of a mixture model with two Bradley-Ter…

Deriving Compact Laws Based on Algebraic Formulation of a Data Set

2017-06-16 · Wenqing Xu, Mark Stalzer

In various subjects, there exist compact and consistent relationships between input and output parameters. Discovering the relationships, or namely compact laws, in a data set is of great interest in many fields, such as…