paper-with-me

Papers

Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensing

2022-08-15 · Baturalp Yalcin, Ziye Ma, Javad Lavaei, Somayeh Sojoudi

Many fundamental low-rank optimization problems, such as matrix completion, phase synchronization/retrieval, power system state estimation, and robust PCA, can be formulated as the matrix sensing problem. Two main approaches for solving matrix sensing are based on semidefinite programming (SDP) and Burer-Monteiro (B-M) factorization. The SDP method suffers from high computational and space complexities, whereas the B-M method may return a spurious solution due to the non-convexity of the problem. The existing theoretical guarantees for the success of these methods have led to similar conservative conditions, which may wrongly imply that these methods have comparable performances. In this paper, we shed light on some major differences between these two methods. First, we present a class of structured matrix completion problems for which the B-M methods fail with an overwhelming probability, while the SDP method works correctly. Second, we identify a class of highly sparse matrix completion problems for which the B-M method works and the SDP method fails. Third, we prove that although the B-M method exhibits the same performance independent of the rank of the unknown solution, the success of the SDP method is correlated to the rank of the solution and improves as the rank increases. Unlike the existing literature that has mainly focused on those instances of matrix sensing for which both SDP and B-M work, this paper offers the first result on the unique merit of each method over the alternative approach.

📄 PDF Abstract BibTeX arXiv:2208.07469

Code (0)

등록된 구현이 없습니다.

Tasks

Matrix CompletionRetrievalState Estimation

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Benign landscape for Burer-Monteiro factorizations of MaxCut-type semidefinite programs

2024-11-05 · Faniriana Rakoto Endor, Irène Waldspurger

We consider MaxCut-type semidefinite programs (SDP) which admit a low rank solution. To numerically leverage the low rank hypothesis, a standard algorithmic approach is the Burer-Monteiro factorization, which allows to s…

Convergence Rate of Block-Coordinate Maximization Burer-Monteiro Method for Solving Large SDPs

2018-07-12 · Murat A. Erdogdu, Asuman Ozdaglar, Pablo A. Parrilo, Nuri Denizcan Vanli

Semidefinite programming (SDP) with diagonal constraints arise in many optimization problems, such as Max-Cut, community detection and group synchronization. Although SDPs can be solved to arbitrary precision in polynomi…

Community Detection

Accelerating Certifiable Estimation with Preconditioned Eigensolvers

2022-07-12 · David M. Rosen

Convex (specifically semidefinite) relaxation provides a powerful approach to constructing robust machine perception systems, enabling the recovery of certifiably globally optimal solutions of challenging estimation prob…

A biconvex optimization for solving semidefinite programs via bilinear factorization

2018-11-03 · En-Liang Hu

Many problems in machine learning can be reduced to learning a low-rank positive semidefinite matrix (denoted as $Z$), which encounters semidefinite program (SDP). Existing SDP solvers by classical convex optimization ar…

Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization

2022-07-05 · Richard Y. Zhang

We consider minimizing a twice-differentiable, $L$-smooth, and $\mu$-strongly convex objective $\phi$ over an $n\times n$ positive semidefinite matrix $M\succeq0$, under the assumption that the minimizer $M^{\star}$ has …