paper-with-me

홈 › Papers

A Block Coordinate Descent-based Projected Gradient Algorithm for Orthogonal Non-negative Matrix Factorization

2020-03-23 · Soodabeh Asadi, Janez Povh

This article utilizes the projected gradient method (PG) for a non-negative matrix factorization problem (NMF), where one or both matrix factors must have orthonormal columns or rows. We penalise the orthonormality constraints and apply the PG method via a block coordinate descent approach. This means that at a certain time one matrix factor is fixed and the other is updated by moving along the steepest descent direction computed from the penalised objective function and projecting onto the space of non-negative matrices. Our method is tested on two sets of synthetic data for various values of penalty parameters. The performance is compared to the well-known multiplicative update (MU) method from Ding (2006), and with a modified global convergent variant of the MU algorithm recently proposed by Mirzal (2014). We provide extensive numerical results coupled with appropriate visualizations, which demonstrate that our method is very competitive and usually outperforms the other two methods.

📄 PDF Abstract BibTeX arXiv:2003.10269

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Block majorization-minimization with diminishing radius for constrained nonsmooth nonconvex optimization

2020-12-07 · Hanbaek Lyu, Yuchen Li

Block majorization-minimization (BMM) is a simple iterative algorithm for constrained nonconvex optimization that sequentially minimizes majorizing surrogates of the objective function in each block while the others are …

Tensor Decomposition

Importance sampling strategy for non-convex randomized block-coordinate descent

2016-06-23 · Rémi Flamary, Alain Rakotomamonjy, Gilles Gasso

As the number of samples and dimensionality of optimization problems related to statistics an machine learning explode, block coordinate descent algorithms have gained popularity since they reduce the original problem to…

Alternating Randomized Block Coordinate Descent

2018-07-01 · ICML 2018 7 · Jelena Diakonikolas, Lorenzo Orecchia

Block-coordinate descent algorithms and alternating minimization methods are fundamental optimization algorithms and an important primitive in large-scale optimization and machine learning. While various block-coord…

Convergence and complexity of block majorization-minimization for constrained block-Riemannian optimization

2023-12-16 · Yuchen Li, Laura Balzano, Deanna Needell, Hanbaek Lyu

Block majorization-minimization (BMM) is a simple iterative algorithm for nonconvex optimization that sequentially minimizes a majorizing surrogate of the objective function in each block coordinate while the other block…

Dictionary LearningRiemannian optimization

Efficient High-Dimensional Data Representation Learning via Semi-Stochastic Block Coordinate Descent Methods

2019-09-25 · Bingkun Wei, Yangyang Li, Fanhua Shang, Yuanyuan Liu 외

With the increase of data volume and data dimension, sparse representation learning attracts more and more attention. For high-dimensional data, randomized block coordinate descent methods perform well because they do no…

Face RecognitionRepresentation Learning