Learning incomplete factorization preconditioners for GMRES
Incomplete LU factorizations of sparse matrices are widely used as preconditioners in Krylov subspace methods to speed up solving linear systems. Unfortunately, computing the preconditioner itself can be time-consuming and sensitive to hyper-parameters. Instead, we replace the hand-engineered algorithm with a graph neural network that is trained to approximate the matrix factorization directly. To apply the output of the neural network as a preconditioner, we propose an output activation function that guarantees that the predicted factorization is invertible. Further, applying a graph neural network architecture allows us to ensure that the output itself is sparse which is desirable from a computational standpoint. We theoretically analyze and empirically evaluate different loss functions to train the learned preconditioners and show their effectiveness in decreasing the number of GMRES iterations and improving the spectral properties on synthetic data. The code is available at https://github.com/paulhausner/neural-incomplete-factorization.
Code (1)
Tasks
Graph Neural Networksubspace methodsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Neural incomplete factorization: learning preconditioners for the conjugate gradient method
The convergence of the conjugate gradient method for solving large-scale and sparse linear equation systems depends on the spectral properties of the system matrix, which can be improved by preconditioning. In this paper…
Computational EfficiencyDeep Learning of Preconditioners for Conjugate Gradient Solvers in Urban Water Related Problems
Solving systems of linear equations is a problem occuring frequently in water engineering applications. Usually the size of the problem is too large to be solved via direct factorization. One can resort to iterative appr…
Graph Neural Preconditioners for Iterative Solutions of Sparse Linear Systems
Preconditioning is at the heart of iterative solutions of large, sparse linear systems of equations in scientific disciplines. Several algebraic approaches, which access no information beyond the matrix itself, are widel…
Learning Sparse Approximate Inverse Preconditioners for Conjugate Gradient Solvers on GPUs
The conjugate gradient solver (CG) is a prevalent method for solving symmetric and positive definite linear systems Ax=b, where effective preconditioners are crucial for fast convergence. Traditional preconditioners rely…
PEARL: Preconditioner Enhancement through Actor-critic Reinforcement Learning
We present PEARL (Preconditioner Enhancement through Actor-critic Reinforcement Learning), a novel approach to learning matrix preconditioners. Existing preconditioners such as Jacobi, Incomplete LU, and Algebraic Multig…
reinforcement-learningReinforcement Learning