paper-with-me

홈 › Papers

Tailed Low-Rank Matrix Factorization for Similarity Matrix Completion

2024-09-29 · Changyi Ma, Runsheng Yu, Xiao Chen, Youzhi Zhang

Similarity matrix serves as a fundamental tool at the core of numerous downstream machine-learning tasks. However, missing data is inevitable and often results in an inaccurate similarity matrix. To address this issue, Similarity Matrix Completion (SMC) methods have been proposed, but they suffer from high computation complexity due to the Singular Value Decomposition (SVD) operation. To reduce the computation complexity, Matrix Factorization (MF) techniques are more explicit and frequently applied to provide a low-rank solution, but the exact low-rank optimal solution can not be guaranteed since it suffers from a non-convex structure. In this paper, we introduce a novel SMC framework that offers a more reliable and efficient solution. Specifically, beyond simply utilizing the unique Positive Semi-definiteness (PSD) property to guide the completion process, our approach further complements a carefully designed rank-minimization regularizer, aiming to achieve an optimal and low-rank solution. Based on the key insights that the underlying PSD property and Low-Rank property improve the SMC performance, we present two novel, scalable, and effective algorithms, SMCNN and SMCNmF, which investigate the PSD property to guide the estimation process and incorporate nonconvex low-rank regularizer to ensure the low-rank solution. Theoretical analysis ensures better estimation performance and convergence speed. Empirical results on real-world datasets demonstrate the superiority and efficiency of our proposed methods compared to various baseline methods.

📄 PDF Abstract BibTeX arXiv:2409.19550

Code (0)

등록된 구현이 없습니다.

Tasks

Matrix Completion

Similar Papers 제목 키워드 기반

Semi-supervised Symmetric Non-negative Matrix Factorization with Low-Rank Tensor Representation

2024-05-04 · Yuheng Jia, Jia-Nan Li, Wenhui Wu, Ran Wang

Semi-supervised symmetric non-negative matrix factorization (SNMF) utilizes the available supervisory information (usually in the form of pairwise constraints) to improve the clustering ability of SNMF. The previous meth…

Matrix factorization with neural networks

2022-12-05 · Francesco Camilli, Marc Mézard

Matrix factorization is an important mathematical problem encountered in the context of dictionary learning, recommendation systems and machine learning. We introduce a new `decimation' scheme that maps it to neural netw…

Dictionary LearningRecommendation Systems

Image Retrieval using Histogram Factorization and Contextual Similarity Learning

2013-04-07 · Liu Liang

Image retrieval has been a top topic in the field of both computer vision and machine learning for a long time. Content based image retrieval, which tries to retrieve images from a database visually similar to a query im…

Content-Based Image RetrievalImage RetrievalRetrieval

MahNMF: Manhattan Non-negative Matrix Factorization

2012-07-14 · Naiyang Guan, DaCheng Tao, Zhigang Luo, John Shawe-Taylor

Non-negative matrix factorization (NMF) approximates a non-negative matrix $X$ by a product of two non-negative low-rank factor matrices $W$ and $H$. NMF and its extensions minimize either the Kullback-Leibler divergence…

Factorization Approach for Low-complexity Matrix Completion Problems: Exponential Number of Spurious Solutions and Failure of Gradient Methods

2021-10-19 · Baturalp Yalcin, Haixiang Zhang, Javad Lavaei, Somayeh Sojoudi

It is well-known that the Burer-Monteiro (B-M) factorization approach can efficiently solve low-rank matrix optimization problems under the RIP condition. It is natural to ask whether B-M factorization-based methods can …

Matrix Completion