paper-with-me

홈 › Papers

A Note on Randomized Kaczmarz Algorithm for Solving Doubly-Noisy Linear Systems

2023-08-31 · El Houcine Bergou, Soumia Boucherouite, Aritra Dutta, Xin Li, Anna Ma

Large-scale linear systems, $Ax=b$, frequently arise in practice and demand effective iterative solvers. Often, these systems are noisy due to operational errors or faulty data-collection processes. In the past decade, the randomized Kaczmarz (RK) algorithm has been studied extensively as an efficient iterative solver for such systems. However, the convergence study of RK in the noisy regime is limited and considers measurement noise in the right-hand side vector, $b$. Unfortunately, in practice, that is not always the case; the coefficient matrix $A$ can also be noisy. In this paper, we analyze the convergence of RK for {\textit{doubly-noisy} linear systems, i.e., when the coefficient matrix, $A$, has additive or multiplicative noise, and $b$ is also noisy}. In our analyses, the quantity $\tilde R=\| \tilde A^{\dagger} \|^2 \|\tilde A \|_F^2$ influences the convergence of RK, where $\tilde A$ represents a noisy version of $A$. We claim that our analysis is robust and realistically applicable, as we do not require information about the noiseless coefficient matrix, $A$, and considering different conditions on noise, we can control the convergence of RK. {We perform numerical experiments to substantiate our theoretical findings.}

📄 PDF Abstract BibTeX arXiv:2308.16904

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An optimal scheduled learning rate for a randomized Kaczmarz algorithm

2022-02-24 · Nicholas F. Marshall, Oscar Mickelin

We study how the learning rate affects the performance of a relaxed randomized Kaczmarz algorithm for solving $A x \approx b + \varepsilon$, where $A x =b$ is a consistent linear system and $\varepsilon$ has independent …

Extension of Sparse Randomized Kaczmarz Algorithm for Multiple Measurement Vectors

2014-01-10 · Hemant Kumar Aggarwal, Angshul Majumdar

The Kaczmarz algorithm is popular for iteratively solving an overdetermined system of linear equations. The traditional Kaczmarz algorithm can approximate the solution in few sweeps through the equations but a randomized…

Face RecognitionFairness

Rows vs Columns for Linear Systems of Equations - Randomized Kaczmarz or Coordinate Descent?

2014-06-20 · Aaditya Ramdas

This paper is about randomized iterative algorithms for solving a linear system of equations $X \beta = y$ in different settings. Recent interest in the topic was reignited when Strohmer and Vershynin (2009) proved the l…

Phase Retrieval via Randomized Kaczmarz: Theoretical Guarantees

2017-06-30 · Yan Shuo Tan, Roman Vershynin

We consider the problem of phase retrieval, i.e. that of solving systems of quadratic equations. A simple variant of the randomized Kaczmarz method was recently proposed for phase retrieval, and it was shown numerically …

Retrieval

Randomized batch-sampling Kaczmarz methods for solving linear systems

2025-11-13 · Dong-Yue Xie, Xi Yang arxiv

To conduct a more in-depth investigation of randomized solvers for solving linear systems, we adopt a unified randomized batch-sampling Kaczmarz framework with per-iteration costs as low as cyclic block methods, and deve…