paper-with-me

홈 › Papers

Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems

2024-12-10 · Rui Li, Song Wang, Chen Wang

Preconditioning techniques are crucial for enhancing the efficiency of solving large-scale linear equation systems that arise from partial differential equation (PDE) discretization. These techniques, such as Incomplete Cholesky factorization (IC) and data-driven neural network methods, accelerate the convergence of iterative solvers like Conjugate Gradient (CG) by approximating the original matrices. This paper introduces a novel approach that integrates Graph Neural Network (GNN) with traditional IC, addressing the shortcomings of direct generation methods based on GNN and achieving significant improvements in computational efficiency and scalability. Experimental results demonstrate an average reduction in iteration counts by 24.8% compared to IC and a two-order-of-magnitude increase in training scale compared to previous methods. A three-dimensional static structural analysis utilizing finite element methods was validated on training sparse matrices of up to 5 million dimensions and inference scales of up to 10 million. Furthermore, the approach demon-strates robust generalization capabilities across scales, facilitating the effective acceleration of CG solvers for large-scale linear equations using small-scale data on modest hardware. The method's robustness and scalability make it a practical solution for computational science.

📄 PDF Abstract BibTeX arXiv:2412.07127

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGraph Neural Network

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Deep Learning of Preconditioners for Conjugate Gradient Solvers in Urban Water Related Problems

2019-06-17 · Johannes Sappl, Laurent Seiler, Matthias Harders, Wolfgang Rauch

Solving systems of linear equations is a problem occuring frequently in water engineering applications. Usually the size of the problem is too large to be solved via direct factorization. One can resort to iterative appr…

Preconditioning Kernel Matrices

2016-02-22 · Kurt Cutajar, Michael A. Osborne, John P. Cunningham, Maurizio Filippone

The computational and storage complexity of kernel machines presents the primary barrier to their scaling to large, modern, datasets. A common way to tackle the scalability issue is to use the conjugate gradient algorith…

Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra

2025-05-16 · Ivan Bioli, Carlo Marcati, Giancarlo Sangalli

Natural Gradient Descent (NGD) has emerged as a promising optimization algorithm for training neural network-based solvers for partial differential equations (PDEs), such as Physics-Informed Neural Networks (PINNs). Howe…

Sketching Meets Random Projection in the Dual: A Provable Recovery Algorithm for Big and High-dimensional Data

2016-10-10 · Jialei Wang, Jason D. Lee, Mehrdad Mahdavi, Mladen Kolar 외

Sketching techniques have become popular for scaling up machine learning algorithms by reducing the sample size or dimensionality of massive data sets, while still maintaining the statistical power of big data. In this p…

Spectral Analysis of the Weighted Frobenius Objective

2025-09-20 · Vladislav Trifonov, Ivan Oseledets, Ekaterina Muravleva arxiv

We analyze a weighted Frobenius loss for approximating symmetric positive definite matrices in the context of preconditioning iterative solvers. Unlike the standard Frobenius norm, the weighted loss penalizes error compo…