paper-with-me

Papers

Approximate message passing from random initialization with applications to $\mathbb{Z}_{2}$ synchronization

2023-02-07 · Gen Li, Wei Fan, Yuting Wei

This paper is concerned with the problem of reconstructing an unknown rank-one matrix with prior structural information from noisy observations. While computing the Bayes-optimal estimator seems intractable in general due to its nonconvex nature, Approximate Message Passing (AMP) emerges as an efficient first-order method to approximate the Bayes-optimal estimator. However, the theoretical underpinnings of AMP remain largely unavailable when it starts from random initialization, a scheme of critical practical utility. Focusing on a prototypical model called $\mathbb{Z}_{2}$ synchronization, we characterize the finite-sample dynamics of AMP from random initialization, uncovering its rapid global convergence. Our theory provides the first non-asymptotic characterization of AMP in this model without requiring either an informative initialization (e.g., spectral initialization) or sample splitting.

📄 PDF Abstract BibTeX arXiv:2302.03682

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

AMP Based on the understanding that the flat local minima of the empirical risk cause the model to generalize better. Adversarial Model Perturbation (AMP) improves generalization via…

Similar Papers 제목 키워드 기반

Optimal Estimation in Orthogonally Invariant Generalized Linear Models: Spectral Initialization and Approximate Message Passing

2026-02-09 · Yihan Zhang, Hong Chang Ji, Ramji Venkataramanan, Marco Mondelli arxiv

We consider the problem of parameter estimation from a generalized linear model with a random design matrix that is orthogonally invariant in law. Such a model allows the design have an arbitrary distribution of singular…

GLAMP: An Approximate Message Passing Framework for Transfer Learning with Applications to Lasso-based Estimators

2025-05-28 · Longlin Wang, Yanke Song, Kuanhao Jiang, Pragya Sur

Approximate Message Passing (AMP) algorithms enable precise characterization of certain classes of random objects in the high-dimensional limit, and have found widespread applications in fields such as statistics, deep l…

DenoisingTransfer Learning

Approximate Message Passing with Spectral Initialization for Generalized Linear Models

2020-10-07 · Marco Mondelli, Ramji Venkataramanan

We consider the problem of estimating a signal from measurements obtained via a generalized linear model. We focus on estimators based on approximate message passing (AMP), a family of iterative algorithms with many appe…

Retrieval

PCA Initialization for Approximate Message Passing in Rotationally Invariant Models

2021-06-04 · NeurIPS 2021 12 · Marco Mondelli, Ramji Venkataramanan

We study the problem of estimating a rank-$1$ signal in the presence of rotationally invariant noise-a class of perturbations more general than Gaussian noise. Principal Component Analysis (PCA) provides a natural estima…

Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models

2025-12-22 · Haohua Chen, Songbin Liu, Junjie Ma arxiv

We propose an orthogonal approximate message passing (OAMP) algorithm for signal estimation in the rectangular spiked matrix model with general rotationally invariant (RI) noise. We establish a rigorous state evolution t…