paper-with-me

Papers

Learning from Linear Algebra: A Graph Neural Network Approach to Preconditioner Design for Conjugate Gradient Solvers

2024-05-24 · Vladislav Trifonov, Alexander Rudikov, Oleg Iliev, Yuri M. Laevsky, Ivan Oseledets, Ekaterina Muravleva

Large linear systems are ubiquitous in modern computational science and engineering. The main recipe for solving them is the use of Krylov subspace iterative methods with well-designed preconditioners. Recently, GNNs have been shown to be a promising tool for designing preconditioners to reduce the overall computational cost of iterative methods by constructing them more efficiently than with classical linear algebra techniques. Preconditioners designed with these approaches cannot outperform those designed with classical methods in terms of the number of iterations in CG. In our work, we recall well-established preconditioners from linear algebra and use them as a starting point for training the GNN to obtain preconditioners that reduce the condition number of the system more significantly than classical preconditioners. Numerical experiments show that our approach outperforms both classical and neural network-based methods for an important class of parametric partial differential equations. We also provide a heuristic justification for the loss function used and show that preconditioners obtained by learning with this loss function reduce the condition number in a more desirable way for CG.

📄 PDF Abstract BibTeX arXiv:2405.15557

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network

Similar Papers 제목 키워드 기반

Deep Learning of Preconditioners for Conjugate Gradient Solvers in Urban Water Related Problems

2019-06-17 · Johannes Sappl, Laurent Seiler, Matthias Harders, Wolfgang Rauch

Solving systems of linear equations is a problem occuring frequently in water engineering applications. Usually the size of the problem is too large to be solved via direct factorization. One can resort to iterative appr…

Graph Neural Preconditioners for Iterative Solutions of Sparse Linear Systems

2024-06-02 · Jie Chen

Preconditioning is at the heart of iterative solutions of large, sparse linear systems of equations in scientific disciplines. Several algebraic approaches, which access no information beyond the matrix itself, are widel…

Neural incomplete factorization: learning preconditioners for the conjugate gradient method

2023-05-25 · Paul Häusner, Ozan Öktem, Jens Sjölund

The convergence of the conjugate gradient method for solving large-scale and sparse linear equation systems depends on the spectral properties of the system matrix, which can be improved by preconditioning. In this paper…

Computational Efficiency

Accelerating CS in Parallel Imaging Reconstructions Using an Efficient and Effective Circulant Preconditioner

2017-10-04 · Kirsten Koolstra, Jeroen van Gemert, Peter Börnert, Andrew Webb 외

Purpose: Design of a preconditioner for fast and efficient parallel imaging and compressed sensing reconstructions. Theory: Parallel imaging and compressed sensing reconstructions become time consuming when the problem s…

compressed sensing

Learning Sparse Approximate Inverse Preconditioners for Conjugate Gradient Solvers on GPUs

2025-10-31 · Zherui Yang, Zhehao Li, Kangbo Lyu, Yixuan Li 외 arxiv

The conjugate gradient solver (CG) is a prevalent method for solving symmetric and positive definite linear systems Ax=b, where effective preconditioners are crucial for fast convergence. Traditional preconditioners rely…