paper-with-me

Papers

Astral: training physics-informed neural networks with error majorants

2024-06-04 · Vladimir Fanaskov, Tianchi Yu, Alexander Rudikov, Ivan Oseledets

The primal approach to physics-informed learning is a residual minimization. We argue that residual is, at best, an indirect measure of the error of approximate solution and propose to train with error majorant instead. Since error majorant provides a direct upper bound on error, one can reliably estimate how close PiNN is to the exact solution and stop the optimization process when the desired accuracy is reached. We call loss function associated with error majorant $\textbf{Astral}$: neur$\textbf{A}$l a po$\textbf{ST}$erio$\textbf{RI}$ function$\textbf{A}$l Loss. To compare Astral and residual loss functions, we illustrate how error majorants can be derived for various PDEs and conduct experiments with diffusion equations (including anisotropic and in the L-shaped domain), convection-diffusion equation, temporal discretization of Maxwell's equation, and magnetostatics problem. The results indicate that Astral loss is competitive to the residual loss, typically leading to faster convergence and lower error (e.g., for Maxwell's equations, we observe an order of magnitude better relative error and training time). We also report that the error estimate obtained with Astral loss is usually tight enough to be informative, e.g., for a highly anisotropic equation, on average, Astral overestimates error by a factor of $1.5$, and for convection-diffusion by a factor of $1.7$.

📄 PDF Abstract BibTeX arXiv:2406.02645

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Energy-based error bound of physics-informed neural network solutions in elasticity

2020-10-18 · Mengwu Guo, Ehsan Haghighat

An energy-based a posteriori error bound is proposed for the physics-informed neural network solutions of elasticity problems. An admissible displacement-stress solution pair is obtained from a mixed form of physics-info…

Integrating Physics-Informed Vectors for Improved Wind Speed Forecasting with Neural Networks

2024-07-05 · Asian Control Conference 2024 7 · Laeeq Aslam, Runmin Zou, Ebrahim Awan, Sharjeel Abid Butt

This paper introduces an approach to enhance wind speed prediction by integrating Physics-Informed Vectors with neural network architectures, specifically Long Short-Term Memory and Temporal Convolution Networks. It also…

Generic bounds on the approximation error for physics-informed (and) operator learning

2022-05-23 · Tim De Ryck, Siddhartha Mishra

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physi…

Operator learning

Error Estimation for Physics-informed Neural Networks Approximating Semilinear Wave Equations

2024-02-11 · Beatrice Lorenz, Aras Bacho, Gitta Kutyniok

This paper provides rigorous error bounds for physics-informed neural networks approximating the semilinear wave equation. We provide bounds for the generalization and training error in terms of the width of the network'…

Error estimates for physics informed neural networks approximating the Navier-Stokes equations

2022-03-17 · Tim De Ryck, Ameya D. Jagtap, Siddhartha Mishra

We prove rigorous bounds on the errors resulting from the approximation of the incompressible Navier-Stokes equations with (extended) physics informed neural networks. We show that the underlying PDE residual can be made…