paper-with-me

홈 › Papers

Mixed-Precision Conjugate Gradient Solvers with RL-Driven Precision Tuning

2025-04-19 · Xinye Chen

This paper presents a novel reinforcement learning (RL) framework for dynamically optimizing numerical precision in the preconditioned conjugate gradient (CG) method. By modeling precision selection as a Markov Decision Process (MDP), we employ Q-learning to adaptively assign precision levels to key operations, striking an optimal balance between computational efficiency and numerical accuracy, while ensuring stability through double-precision scalar computations and residual computing. In practice, the algorithm is trained on a set of data and subsequently performs inference for precision selection on out-of-sample data, without requiring re-analysis or retraining for new datasets. This enables the method to adapt seamlessly to new problem instances without the computational overhead of recalibration. Our results demonstrate the effectiveness of RL in enhancing solver's performance, marking the first application of RL to mixed-precision numerical methods. The findings highlight the approach's practical advantages, robustness, and scalability, providing valuable insights into its integration with iterative solvers and paving the way for AI-driven advancements in scientific computing.

📄 PDF Abstract BibTeX arXiv:2504.14268

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyQ-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Low-Precision Arithmetic for Fast Gaussian Processes

2022-07-14 · Wesley J. Maddox, Andres Potapczynski, Andrew Gordon Wilson

Low-precision arithmetic has had a transformative effect on the training of neural networks, reducing computation, memory and energy requirements. However, despite its promise, low-precision arithmetic has received littl…

Gaussian ProcessesGPU

Accelerating Conjugate Gradient Solvers for Homogenization Problems with Unitary Neural Operators

2025-07-18 · Julius Herb, Felix Fritzen arxiv

Rapid and reliable solvers for parametric partial differential equations (PDEs) are needed in many scientific and engineering disciplines. For example, there is a growing demand for composites and architected materials w…

Conjugate gradient methods for high-dimensional GLMMs

2024-11-07 · Andrea Pandolfi, Omiros Papaspiliopoulos, Giacomo Zanella

Generalized linear mixed models (GLMMs) are a widely used tool in statistical analysis. The main bottleneck of many computational approaches lies in the inversion of the high dimensional precision matrices associated wit…

Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems

2024-12-10 · Rui Li, Song Wang, Chen Wang

Preconditioning techniques are crucial for enhancing the efficiency of solving large-scale linear equation systems that arise from partial differential equation (PDE) discretization. These techniques, such as Incomplete …

Computational EfficiencyGraph Neural Network

Conjugate gradient MIMO iterative learning control using data-driven stochastic gradients

2021-11-16 · Leontine Aarnoudse, Tom Oomen

Data-driven iterative learning control can achieve high performance for systems performing repeating tasks without the need for modeling. The aim of this paper is to develop a fast data-driven method for iterative learni…