paper-with-me

홈 › Papers

Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method

2025-07-31 · Alena Kopaničáková, Youngkyu Lee, George Em Karniadakis arxiv

We propose a new deflation strategy to accelerate the convergence of the preconditioned conjugate gradient(PCG) method for solving parametric large-scale linear systems of equations. Unlike traditional deflation techniques that rely on eigenvector approximations or recycled Krylov subspaces, we generate the deflation subspaces using operator learning, specifically the Deep Operator Network~(DeepONet). To this aim, we introduce two complementary approaches for assembling the deflation operators. The first approach approximates near-null space vectors of the discrete PDE operator using the basis functions learned by the DeepONet. The second approach directly leverages solutions predicted by the DeepONet. To further enhance convergence, we also propose several strategies for prescribing the sparsity pattern of the deflation operator. A comprehensive set of numerical experiments encompassing steady-state, time-dependent, scalar, and vector-valued problems posed on both structured and unstructured geometries is presented and demonstrates the effectiveness of the proposed DeepONet-based deflated PCG method, as well as its generalization across a wide range of model parameters and problem resolutions.

📄 PDF Abstract BibTeX arXiv:2508.00101

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models

2024-06-12 · Xiang Meng, Kayhan Behdin, Haoyue Wang, Rahul Mazumder

The impressive performance of Large Language Models (LLMs) across various natural language processing tasks comes at the cost of vast computational resources and storage requirements. One-shot pruning techniques offer a …

GPU

Neural-network preconditioners for solving the Dirac equation in lattice gauge theory

2022-08-04 · Salvatore Calì, Daniel C. Hackett, Yin Lin, Phiala E. Shanahan 외

This work develops neural-network--based preconditioners to accelerate solution of the Wilson-Dirac normal equation in lattice quantum field theories. The approach is implemented for the two-flavor lattice Schwinger mode…

HPPP: Halpern-type Preconditioned Proximal Point Algorithms and Applications to Image Restoration

2024-07-18 · Shuchang Zhang, HUI ZHANG, Hongxia Wang

Recently, the degenerate preconditioned proximal point (PPP) method provides a unified and flexible framework for designing and analyzing operator-splitting algorithms such as Douglas-Rachford (DR). However, the degenera…

DeblurringDenoisingImage DeblurringImage Restoration

Preconditioning for Accelerated Iteratively Reweighted Least Squares in Structured Sparsity Reconstruction

2014-06-01 · CVPR 2014 6 · Chen Chen, Junzhou Huang, Lei He, Hongsheng Li

In this paper, we propose a novel algorithm for structured sparsity reconstruction. This algorithm is based on the iterative reweighted least squares (IRLS) framework, and accelerated by the preconditioned conjugate grad…

Compressive Sensing

Multidirectional Conjugate Gradients for Scalable Bundle Adjustment

2021-10-08 · Simon Weber, Nikolaus Demmel, Daniel Cremers

We revisit the problem of large-scale bundle adjustment and propose a technique called Multidirectional Conjugate Gradients that accelerates the solution of the normal equation by up to 61%. The key idea is that we enlar…