paper-with-me

홈 › Papers

A universal framework for learning the elliptical mixture model

2018-05-21 · Shengxi Li, Zeyang Yu, Danilo Mandic

Mixture modelling using elliptical distributions promises enhanced robustness, flexibility and stability over the widely employed Gaussian mixture model (GMM). However, existing studies based on the elliptical mixture model (EMM) are restricted to several specific types of elliptical probability density functions, which are not supported by general solutions or systematic analysis frameworks; this significantly limits the rigour and the power of EMMs in applications. To this end, we propose a novel general framework for estimating and analysing the EMMs, achieved through Riemannian manifold optimisation. First, we investigate the relationships between Riemannian manifolds and elliptical distributions, and the so established connection between the original manifold and a reformulated one indicates a mismatch between those manifolds, the major cause of failure of the existing optimisation for solving general EMMs. We next propose a universal solver which is based on the optimisation of a re-designed cost and prove the existence of the same optimum as in the original problem; this is achieved in a simple, fast and stable way. We further calculate the influence functions of the EMM as theoretical bounds to quantify robustness to outliers. Comprehensive numerical results demonstrate the ability of the proposed framework to accommodate EMMs with different properties of individual functions in a stable way and with fast convergence speed. Finally, the enhanced robustness and flexibility of the proposed framework over the standard GMM are demonstrated both analytically and through comprehensive simulations.

📄 PDF Abstract BibTeX arXiv:1805.08045

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Robust and Flexible EM Algorithm for Mixtures of Elliptical Distributions with Missing Data

2022-01-28 · Florian Mouret, Alexandre Hippert-Ferrer, Frédéric Pascal, Jean-Yves Tourneret

This paper tackles the problem of missing data imputation for noisy and non-Gaussian data. A classical imputation method, the Expectation Maximization (EM) algorithm for Gaussian mixture models, has shown interesting pro…

Imputation

Variational Elliptical Processes

2023-11-21 · Maria Bånkestad, Jens Sjölund, Jalil Taghia, Thomas B. Schöon

We present elliptical processes, a family of non-parametric probabilistic models that subsume Gaussian processes and Student's t processes. This generalization includes a range of new heavy-tailed behaviors while retaini…

Gaussian ProcessesVariational Inference

The Elliptical Processes: a Family of Fat-tailed Stochastic Processes

2020-03-13 · Maria Bånkestad, Jens Sjölund, Jalil Taghia, Thomas Schön

We present the elliptical processes -- a family of non-parametric probabilistic models that subsumes the Gaussian process and the Student-t process. This generalization includes a range of new fat-tailed behaviors yet re…

Gaussian Processesregression

Consistency for constrained maximum likelihood estimation and clustering based on mixtures of elliptically-symmetric distributions under general data generating processes

2023-11-10 · Pietro Coretto, Christian Hennig

The consistency of the maximum likelihood estimator for mixtures of elliptically-symmetric distributions for estimating its population version is shown, where the underlying distribution $P$ is nonparametric and does not…

Towards transferring Bulgarian Sentences with Elliptical Elements to Universal Dependencies: issues and strategies

2019-08-01 · WS 2019 8 · Petya Osenova, Kiril Simov