paper-with-me

Papers

Learning incomplete factorization preconditioners for GMRES

2024-09-12 · Paul Häusner, Aleix Nieto Juscafresa, Jens Sjölund

Incomplete LU factorizations of sparse matrices are widely used as preconditioners in Krylov subspace methods to speed up solving linear systems. Unfortunately, computing the preconditioner itself can be time-consuming and sensitive to hyper-parameters. Instead, we replace the hand-engineered algorithm with a graph neural network that is trained to approximate the matrix factorization directly. To apply the output of the neural network as a preconditioner, we propose an output activation function that guarantees that the predicted factorization is invertible. Further, applying a graph neural network architecture allows us to ensure that the output itself is sparse which is desirable from a computational standpoint. We theoretically analyze and empirically evaluate different loss functions to train the learned preconditioners and show their effectiveness in decreasing the number of GMRES iterations and improving the spectral properties on synthetic data. The code is available at https://github.com/paulhausner/neural-incomplete-factorization.

📄 PDF Abstract BibTeX arXiv:2409.08262

Code (1)

paulhausner/neural-incomplete-factorization 공식 구현 pytorch

Tasks

Graph Neural Networksubspace methods

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Neural incomplete factorization: learning preconditioners for the conjugate gradient method

2023-05-25 · Paul Häusner, Ozan Öktem, Jens Sjölund

The convergence of the conjugate gradient method for solving large-scale and sparse linear equation systems depends on the spectral properties of the system matrix, which can be improved by preconditioning. In this paper…

Computational Efficiency

Deep Learning of Preconditioners for Conjugate Gradient Solvers in Urban Water Related Problems

2019-06-17 · Johannes Sappl, Laurent Seiler, Matthias Harders, Wolfgang Rauch

Solving systems of linear equations is a problem occuring frequently in water engineering applications. Usually the size of the problem is too large to be solved via direct factorization. One can resort to iterative appr…

Graph Neural Preconditioners for Iterative Solutions of Sparse Linear Systems

2024-06-02 · Jie Chen

Preconditioning is at the heart of iterative solutions of large, sparse linear systems of equations in scientific disciplines. Several algebraic approaches, which access no information beyond the matrix itself, are widel…

Learning Sparse Approximate Inverse Preconditioners for Conjugate Gradient Solvers on GPUs

2025-10-31 · Zherui Yang, Zhehao Li, Kangbo Lyu, Yixuan Li 외 arxiv

The conjugate gradient solver (CG) is a prevalent method for solving symmetric and positive definite linear systems Ax=b, where effective preconditioners are crucial for fast convergence. Traditional preconditioners rely…

PEARL: Preconditioner Enhancement through Actor-critic Reinforcement Learning

2025-01-18 · David Millard, Arielle Carr, Stéphane Gaudreault, Ali Baheri

We present PEARL (Preconditioner Enhancement through Actor-critic Reinforcement Learning), a novel approach to learning matrix preconditioners. Existing preconditioners such as Jacobi, Incomplete LU, and Algebraic Multig…

reinforcement-learningReinforcement Learning