Memory Approximate Message Passing

2021-06-04 · Lei Liu, Shunqi Huang, Brian M. Kurkoski

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID) transform matrices, but may become unreliable for other matrix ensembles, especially for ill-conditioned ones. To handle this difficulty, orthogonal/vector AMP (OAMP/VAMP) was proposed for general right-unitarily-invariant matrices. However, the Bayes-optimal OAMP/VAMP requires high-complexity linear minimum mean square error estimator. To solve the disadvantages of AMP and OAMP/VAMP, this paper proposes a memory AMP (MAMP), in which a long-memory matched filter is proposed for interference suppression. The complexity of MAMP is comparable to AMP. The asymptotic Gaussianity of estimation errors in MAMP is guaranteed by the orthogonality principle. A state evolution is derived to asymptotically characterize the performance of MAMP. Based on the state evolution, the relaxation parameters and damping vector in MAMP are optimized. For all right-unitarily-invariant matrices, the optimized MAMP converges to OAMP/VAMP, and thus is Bayes-optimal if it has a unique fixed point. Finally, simulations are provided to verify the validity and accuracy of the theoretical results.

📄 PDF Abstract BibTeX arXiv:2106.02237

Code (0)

등록된 구현이 없습니다.

Tasks

parameter estimation

Methods 이 논문이 사용한 방법론

AMP Based on the understanding that the flat local minima of the empirical risk cause the model to generalize better. Adversarial Model Perturbation (AMP) improves generalization via…

Message Passing Based Two-Timescale Bayesian Learning for Joint Channel and Memory Hardware Impairments Tracking

2026-07-02 · Wei Xu, An Liu arxiv

Hardware impairments in massive multiple-input multiple-output (MIMO) receivers introduce inter-symbol memory and inter-element coupling, severely degrading channel estimation. This paper employs a residual recurrent gat…

Sufficient Statistic Memory Approximate Message Passing

2022-06-23 · Lei Liu, Shunqi Huang, Brian M. Kurkoski

Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctl…

Vocal Bursts Type Prediction

Distributed Memory Approximate Message Passing

2024-07-25 · Jun Lu, Lei Liu, Shunqi Huang, Ning Wei 외

Approximate message passing (AMP) algorithms are iterative methods for signal recovery in noisy linear systems. In some scenarios, AMP algorithms need to operate within a distributed network. To address this challenge, t…

Distributed Computing

Memory-based Message Passing: Decoupling the Message for Propogation from Discrimination

2022-02-01 · Jie Chen, Weiqi Liu, Jian Pu

Message passing is a fundamental procedure for graph neural networks in the field of graph representation learning. Based on the homophily assumption, the current message passing always aggregates features of connected n…

Graph Representation Learning Representation Learning

Matrix completion based on Gaussian parameterized belief propagation

2021-05-01 · Koki Okajima, Yoshiyuki Kabashima

We develop a message-passing algorithm for noisy matrix completion problems based on matrix factorization. The algorithm is derived by approximating message distributions of belief propagation with Gaussian distributions…

Matrix Completion