A Fast Incremental Gaussian Mixture Model

2015-06-14 · Rafael Pinto, Paulo Engel

This work builds upon previous efforts in online incremental learning, namely the Incremental Gaussian Mixture Network (IGMN). The IGMN is capable of learning from data streams in a single-pass by improving its model after analyzing each data point and discarding it thereafter. Nevertheless, it suffers from the scalability point-of-view, due to its asymptotic time complexity of $\operatorname{O}\bigl(NKD^3\bigr)$ for $N$ data points, $K$ Gaussian components and $D$ dimensions, rendering it inadequate for high-dimensional data. In this paper, we manage to reduce this complexity to $\operatorname{O}\bigl(NKD^2\bigr)$ by deriving formulas for working directly with precision matrices instead of covariance matrices. The final result is a much faster and scalable algorithm which can be applied to high dimensional tasks. This is confirmed by applying the modified algorithm to high-dimensional classification datasets.

📄 PDF Abstract BibTeX arXiv:1506.04422

Code (0)

등록된 구현이 없습니다.

Tasks

Incremental Learningmodel

Scalable and Incremental Learning of Gaussian Mixture Models

2017-01-14 · Rafael Pinto, Paulo Engel

This work presents a fast and scalable algorithm for incremental learning of Gaussian mixture models. By performing rank-one updates on its precision matrices and determinants, its asymptotic time complexity is of \BigO{…

General Classification Incremental Learning reinforcement-learning Reinforcement Learning+1

Fast Reinforcement Learning with Incremental Gaussian Mixture Models

2020-11-02 · Rafael Pinto

This work presents a novel algorithm that integrates a data-efficient function approximator with reinforcement learning in continuous state spaces. An online and incremental algorithm capable of learning from a single pa…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

N-Dimensional Gaussians for Fitting of High Dimensional Functions

2024-05-30 · Stavros Diolatzis, Tobias Zirr, Alexandr Kuznetsov, Georgios Kopanas 외

In the wake of many new ML-inspired approaches for reconstructing and representing high-quality 3D content, recent hybrid and explicitly learned representations exhibit promising performance and quality characteristics. …

Incremental Multimodal Surface Mapping via Self-Organizing Gaussian Mixture Models

2023-09-19 · Kshitij Goel, Wennie Tabib

This letter describes an incremental multimodal surface mapping methodology, which represents the environment as a continuous probabilistic model. This model enables high-resolution reconstruction while simultaneously co…

Generalized Fast Multichannel Nonnegative Matrix Factorization Based on Gaussian Scale Mixtures for Blind Source Separation

2022-05-11 · Mathieu Fontaine, Kouhei Sekiguchi, Aditya Nugraha, Yoshiaki Bando 외

This paper describes heavy-tailed extensions of a state-of-the-art versatile blind source separation method called fast multichannel nonnegative matrix factorization (FastMNMF) from a unified point of view. The common wa…

blind source separation Speech Enhancement