paper-with-me

Papers

A variational autoencoder-based nonnegative matrix factorisation model for deep dictionary learning

2023-01-18 · Hong-Bo Xie, Caoyuan Li, Shuliang Wang, Richard Yi Da Xu, Kerrie Mengersen

Construction of dictionaries using nonnegative matrix factorisation (NMF) has extensive applications in signal processing and machine learning. With the advances in deep learning, training compact and robust dictionaries using deep neural networks, i.e., dictionaries of deep features, has been proposed. In this study, we propose a probabilistic generative model which employs a variational autoencoder (VAE) to perform nonnegative dictionary learning. In contrast to the existing VAE models, we cast the model under a statistical framework with latent variables obeying a Gamma distribution and design a new loss function to guarantee the nonnegative dictionaries. We adopt an acceptance-rejection sampling reparameterization trick to update the latent variables iteratively. We apply the dictionaries learned from VAE-NMF to two signal processing tasks, i.e., enhancement of speech and extraction of muscle synergies. Experimental results demonstrate that VAE-NMF performs better in learning the latent nonnegative dictionaries in comparison with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2301.07272

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary Learning

Similar Papers 제목 키워드 기반

Comparative Study of Inference Methods for Bayesian Nonnegative Matrix Factorisation

2017-07-13 · Thomas Brouwer, Jes Frellsen, Pietro Lió

In this paper, we study the trade-offs of different inference approaches for Bayesian matrix factorisation methods, which are commonly used for predicting missing values, and for finding patterns in the data. In particul…

Bayesian InferenceMissing ValuesModel Selection

A Variational Autoencoder for Probabilistic Non-Negative Matrix Factorisation

2019-06-13 · ICLR 2019 5 · Steven Squires, Adam Prügel Bennett, Mahesan Niranjan

We introduce and demonstrate the variational autoencoder (VAE) for probabilistic non-negative matrix factorisation (PAE-NMF). We design a network which can perform non-negative matrix factorisation (NMF) and add in aspec…

Time SeriesTime Series Analysis

An Online Expectation-Maximisation Algorithm for Nonnegative Matrix Factorisation Models

2014-01-11 · Sinan Yildirim, A. Taylan Cemgil, Sumeetpal S. Singh

In this paper we formulate the nonnegative matrix factorisation (NMF) problem as a maximum likelihood estimation problem for hidden Markov models and propose online expectation-maximisation (EM) algorithms to estimate th…

Prior and Likelihood Choices for Bayesian Matrix Factorisation on Small Datasets

2017-12-01 · Thomas Brouwer, Pietro Lio'

In this paper, we study the effects of different prior and likelihood choices for Bayesian matrix factorisation, focusing on small datasets. These choices can greatly influence the predictive performance of the methods. …

Model Selection

Fast Bayesian Non-Negative Matrix Factorisation and Tri-Factorisation

2016-10-26 · Thomas Brouwer, Jes Frellsen, Pietro Lio'

We present a fast variational Bayesian algorithm for performing non-negative matrix factorisation and tri-factorisation. We show that our approach achieves faster convergence per iteration and timestep (wall-clock) than …