paper-with-me

홈 › Papers

Learning and Free Energies for Vector Approximate Message Passing

2016-02-26 · Alyson K. Fletcher, Philip Schniter

Vector approximate message passing (VAMP) is a computationally simple approach to the recovery of a signal $\mathbf{x}$ from noisy linear measurements $\mathbf{y}=\mathbf{Ax}+\mathbf{w}$. Like the AMP proposed by Donoho, Maleki, and Montanari in 2009, VAMP is characterized by a rigorous state evolution (SE) that holds under certain large random matrices and that matches the replica prediction of optimality. But while AMP's SE holds only for large i.i.d. sub-Gaussian $\mathbf{A}$, VAMP's SE holds under the much larger class: right-rotationally invariant $\mathbf{A}$. To run VAMP, however, one must specify the statistical parameters of the signal and noise. This work combines VAMP with Expectation-Maximization to yield an algorithm, EM-VAMP, that can jointly recover $\mathbf{x}$ while learning those statistical parameters. The fixed points of the proposed EM-VAMP algorithm are shown to be stationary points of a certain constrained free-energy, providing a variational interpretation of the algorithm. Numerical simulations show that EM-VAMP is robust to highly ill-conditioned $\mathbf{A}$ with performance nearly matching oracle-parameter VAMP.

📄 PDF Abstract BibTeX arXiv:1602.08207

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Properties of Bethe Free Energies and Message Passing in Gaussian Models

2014-01-16 · Botond Cseke, Tom Heskes

We address the problem of computing approximate marginals in Gaussian probabilistic models by using mean field and fractional Bethe approximations. We define the Gaussian fractional Bethe free energy in terms of the mome…

Replica Analysis of the Linear Model with Markov or Hidden Markov Signal Priors

2020-09-28 · Lan V. Truong

This paper estimates free energy, average mutual information, and minimum mean square error (MMSE) of a linear model under two assumptions: (1) the source is generated by a Markov chain, (2) the source is generated via a…

Decoder

Hybrid Vector Message Passing for Generalized Bilinear Factorization

2024-01-08 · Hao Jiang, Xiaojun Yuan, Qinghua Guo

In this paper, we propose a new message passing algorithm that utilizes hybrid vector message passing (HVMP) to solve the generalized bilinear factorization (GBF) problem. The proposed GBF-HVMP algorithm integrates expec…

Replicated Vector Approximate Message Passing For Resampling Problem

2019-05-23 · Takashi Takahashi, Yoshiyuki Kabashima

Resampling techniques are widely used in statistical inference and ensemble learning, in which estimators' statistical properties are essential. However, existing methods are computationally demanding, because repetition…

Ensemble LearningVariable Selection

Generating Functional Analysis of Iterative Sparse Signal Recovery Algorithms with Divergence-Free Estimators

2018-03-28

Approximate message passing (AMP) is an effective iterative sparse recovery algorithm for linear system models. Its performance is characterized by the state evolution (SE) which is a simple scalar recursion. However, de…