paper-with-me

Papers

Deep Nonnegative Matrix Factorization with Beta Divergences

2023-09-15 · Valentin Leplat, Le Thi Khanh Hien, Akwum Onwunta, Nicolas Gillis

Deep Nonnegative Matrix Factorization (deep NMF) has recently emerged as a valuable technique for extracting multiple layers of features across different scales. However, all existing deep NMF models and algorithms have primarily centered their evaluation on the least squares error, which may not be the most appropriate metric for assessing the quality of approximations on diverse datasets. For instance, when dealing with data types such as audio signals and documents, it is widely acknowledged that $\beta$-divergences offer a more suitable alternative. In this paper, we develop new models and algorithms for deep NMF using some $\beta$-divergences, with a focus on the Kullback-Leibler divergence. Subsequently, we apply these techniques to the extraction of facial features, the identification of topics within document collections, and the identification of materials within hyperspectral images.

📄 PDF Abstract BibTeX arXiv:2309.08249

Code (2)

vleplat/deep-beta-nmf-public 공식 구현
vleplat/deep-kl-nmf-public 공식 구현

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Multiplicative Updates for NMF with $β$-Divergences under Disjoint Equality Constraints

2020-10-30 · Valentin Leplat, Nicolas Gillis, Jérôme Idier

Nonnegative matrix factorization (NMF) is the problem of approximating an input nonnegative matrix, $V$, as the product of two smaller nonnegative matrices, $W$ and $H$. In this paper, we introduce a general framework to…

Joint Majorization-Minimization for Nonnegative Matrix Factorization with the $β$-divergence

2021-06-29 · Arthur Marmin, José Henrique de Morais Goulart, Cédric Févotte

This article proposes new multiplicative updates for nonnegative matrix factorization (NMF) with the $\beta$-divergence objective function. Our new updates are derived from a joint majorization-minimization (MM) scheme, …

CPU

Learning the Information Divergence

2014-06-05 · Onur Dikmen, Zhirong Yang, Erkki Oja

Information divergence that measures the difference between two nonnegative matrices or tensors has found its use in a variety of machine learning problems. Examples are Nonnegative Matrix/Tensor Factorization, Stochasti…

BIG-bench Machine LearningTopic Models

Automatic Relevance Determination in Nonnegative Matrix Factorization with the β-Divergence

2011-11-25 · Vincent Y. F. Tan, Cédric Févotte

This paper addresses the estimation of the latent dimensionality in nonnegative matrix factorization (NMF) with the \beta-divergence. The \beta-divergence is a family of cost functions that includes the squared Euclidean…

Stock Price Prediction

Block Majorization Minimization with Extrapolation and Application to $β$-NMF

2024-01-12 · Le Thi Khanh Hien, Valentin Leplat, Nicolas Gillis

We propose a Block Majorization Minimization method with Extrapolation (BMMe) for solving a class of multi-convex optimization problems. The extrapolation parameters of BMMe are updated using a novel adaptive update rule…