paper-with-me

Papers

Stiff Transfer Learning for Physics-Informed Neural Networks

2025-01-28 · Emilien Seiler, Wanzhou Lei, Pavlos Protopapas

Stiff differential equations are prevalent in various scientific domains, posing significant challenges due to the disparate time scales of their components. As computational power grows, physics-informed neural networks (PINNs) have led to significant improvements in modeling physical processes described by differential equations. Despite their promising outcomes, vanilla PINNs face limitations when dealing with stiff systems, known as failure modes. In response, we propose a novel approach, stiff transfer learning for physics-informed neural networks (STL-PINNs), to effectively tackle stiff ordinary differential equations (ODEs) and partial differential equations (PDEs). Our methodology involves training a Multi-Head-PINN in a low-stiff regime, and obtaining the final solution in a high stiff regime by transfer learning. This addresses the failure modes related to stiffness in PINNs while maintaining computational efficiency by computing "one-shot" solutions. The proposed approach demonstrates superior accuracy and speed compared to PINNs-based methods, as well as comparable computational efficiency with implicit numerical methods in solving stiff-parameterized linear and polynomial nonlinear ODEs and PDEs under stiff conditions. Furthermore, we demonstrate the scalability of such an approach and the superior speed it offers for simulations involving initial conditions and forcing function reparametrization.

📄 PDF Abstract BibTeX arXiv:2501.17281

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyTransfer Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Differentiable Chemistry in PINNs for Solving Parameterized and Stiff Reaction Systems

2026-05-06 · Miloš Babić, Franz M. Rohrhofer, Stefan Posch arxiv

From neural ODEs to continuous-time machine learning, differentiable solvers allow physics, optimization, and simulation to become trainable components within deep learning systems. This has opened the path to a new gene…

Reduced-PINN: An Integration-Based Physics-Informed Neural Networks for Stiff ODEs

2022-08-23 · Pouyan Nasiri, Roozbeh Dargazany

Physics-informed neural networks (PINNs) have recently received much attention due to their capabilities in solving both forward and inverse problems. For training a deep neural network associated with a PINN, one typica…

Solving stiff dark matter equations via Jacobian Normalization with Physics-Informed Neural Networks

2026-02-25 · M. P. Bento, H. B. Câmara, J. R. Rocha, J. F. Seabra arxiv

Stiff differential equations pose a major challenge for Physics-Informed Neural Networks (PINNs), often causing poor convergence. We propose a simple, hyperparameter-free method to address stiffness by normalizing loss r…

Physics-Informed Neural ODEs with Scale-Aware Residuals for Learning Stiff Biophysical Dynamics

2025-11-13 · Kamalpreet Singh Kainth, Prathamesh Dinesh Joshi, Raj Abhijit Dandekar, Rajat Dandekar 외 arxiv

Neural differential equations offer a powerful framework for modeling continuous-time dynamics, but forecasting stiff biophysical systems remains unreliable. Standard Neural ODEs and physics informed variants often requi…

Physics-informed Gaussian process model for Euler-Bernoulli beam elements

2023-08-05 · Gledson Rodrigo Tondo, Sebastian Rau, Igor Kavrakov, Guido Morgenthal

A physics-informed machine learning model, in the form of a multi-output Gaussian process, is formulated using the Euler-Bernoulli beam equation. Given appropriate datasets, the model can be used to regress the analytica…

Cantilever BeamPhysics-informed machine learningStructural Health Monitoring