paper-with-me

홈 › Papers

Fundamental limits of Non-Linear Low-Rank Matrix Estimation

2024-03-07 · Pierre Mergny, Justin Ko, Florent Krzakala, Lenka Zdeborová

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective prior, whose parameters are entirely determined by an expansion of the non-linear function. In particular, we show that to reconstruct the signal accurately, one requires a signal-to-noise ratio growing as $N^{\frac 12 (1-1/k_F)}$, where $k_F$ is the first non-zero Fisher information coefficient of the function. We provide asymptotic characterization for the minimal achievable mean squared error (MMSE) and an approximate message-passing algorithm that reaches the MMSE under conditions analogous to the linear version of the problem. We also provide asymptotic errors achieved by methods such as principal component analysis combined with Bayesian denoising, and compare them with Bayes-optimal MMSE.

📄 PDF Abstract BibTeX arXiv:2403.04234

Code (0)

등록된 구현이 없습니다.

Tasks

Denoising

Similar Papers 제목 키워드 기반

Fundamental limits for rank-one matrix estimation with groupwise heteroskedasticity

2021-06-22 · Joshua K. Behne, Galen Reeves

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits…

ClusteringCommunity Detection

Near-optimal Rank Adaptive Inference of High Dimensional Matrices

2025-10-09 · Frédéric Zheng, Yassir Jedra, Alexandre Proutiere arxiv

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and…

0-1 phase transitions in sparse spiked matrix estimation

2019-11-12 · Jean Barbier, Nicolas Macris

We consider statistical models of estimation of a rank-one matrix (the spike) corrupted by an additive gaussian noise matrix in the sparse limit. In this limit the underlying hidden vector (that constructs the rank-one m…

Image RestorationObject CountingSemantic SegmentationWord Sense Disambiguation

Learning Factorized Weight Matrix for Joint Image Filtering

2020-01-01 · ICML 2020 1 · Xiangyu Xu, Yongrui Ma, Wenxiu Sun

Joint image filtering is a fundamental problem in computer vision with applications in many different areas. Most existing algorithms solve this problem with a weighted averaging process to aggregate input pixels. Howeve…

Feature Correlation

Fundamental limits of detection in the spiked Wigner model

2018-06-25 · Ahmed El Alaoui, Florent Krzakala, Michael. I. Jordan

We study the fundamental limits of detecting the presence of an additive rank-one perturbation, or spike, to a Wigner matrix. When the spike comes from a prior that is i.i.d. across coordinates, we prove that the log-lik…