paper-with-me

Papers

A majorization-minimization algorithm for nonnegative binary matrix factorization

2022-04-20 · Paul Magron, Cédric Févotte

This paper tackles the problem of decomposing binary data using matrix factorization. We consider the family of mean-parametrized Bernoulli models, a class of generative models that are well suited for modeling binary data and enables interpretability of the factors. We factorize the Bernoulli parameter and consider an additional Beta prior on one of the factors to further improve the model's expressive power. While similar models have been proposed in the literature, they only exploit the Beta prior as a proxy to ensure a valid Bernoulli parameter in a Bayesian setting; in practice it reduces to a uniform or uninformative prior. Besides, estimation in these models has focused on costly Bayesian inference. In this paper, we propose a simple yet very efficient majorization-minimization algorithm for maximum a posteriori estimation. Our approach leverages the Beta prior whose parameters can be tuned to improve performance in matrix completion tasks. Experiments conducted on three public binary datasets show that our approach offers an excellent trade-off between prediction performance, computational complexity, and interpretability.

📄 PDF Abstract BibTeX arXiv:2204.09741

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceMatrix Completionvalid

Similar Papers 제목 키워드 기반

Block Majorization Minimization with Extrapolation and Application to $β$-NMF

2024-01-12 · Le Thi Khanh Hien, Valentin Leplat, Nicolas Gillis

We propose a Block Majorization Minimization method with Extrapolation (BMMe) for solving a class of multi-convex optimization problems. The extrapolation parameters of BMMe are updated using a novel adaptive update rule…

Majorization-minimization for Sparse Nonnegative Matrix Factorization with the $β$-divergence

2022-07-13 · Arthur Marmin, José Henrique de Morais Goulart, Cédric Févotte

This article introduces new multiplicative updates for nonnegative matrix factorization with the $\beta$-divergence and sparse regularization of one of the two factors (say, the activation matrix). It is well known that …

CPU

Joint Majorization-Minimization for Nonnegative Matrix Factorization with the $β$-divergence

2021-06-29 · Arthur Marmin, José Henrique de Morais Goulart, Cédric Févotte

This article proposes new multiplicative updates for nonnegative matrix factorization (NMF) with the $\beta$-divergence objective function. Our new updates are derived from a joint majorization-minimization (MM) scheme, …

CPU

Algorithms for nonnegative matrix factorization with the beta-divergence

2010-10-08 · Cédric Févotte, Jérôme Idier

This paper describes algorithms for nonnegative matrix factorization (NMF) with the beta-divergence (beta-NMF). The beta-divergence is a family of cost functions parametrized by a single shape parameter beta that takes t…

A Second-Order Majorant Algorithm for Nonnegative Matrix Factorization

2023-03-31 · Mai-Quyen Pham, Jérémy Cohen, Thierry Chonavel

Nonnegative Matrix Factorization (NMF) is a fundamental tool in unsupervised learning, widely used for tasks such as dimensionality reduction, feature extraction, representation learning, and topic modeling. Many algorit…

Dimensionality ReductionRepresentation Learning