paper-with-me

홈 › Papers

Improved Training of Physics-Informed Neural Networks with Model Ensembles

2022-04-11 · Katsiaryna Haitsiukevich, Alexander Ilin

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training such physics-informed neural networks (PINNs) is notoriously difficult in practice since PINNs often converge to wrong solutions. In this paper, we address this problem by training an ensemble of PINNs. Our approach is motivated by the observation that individual PINN models find similar solutions in the vicinity of points with targets (e.g., observed data or initial conditions) while their solutions may substantially differ farther away from such points. Therefore, we propose to use the ensemble agreement as the criterion for gradual expansion of the solution interval, that is including new points for computing the loss derived from differential equations. Due to the flexibility of the domain expansion, our algorithm can easily incorporate measurements in arbitrary locations. In contrast to the existing PINN algorithms with time-adaptive strategies, the proposed algorithm does not need a pre-defined schedule of interval expansion and it treats time and space equally. We experimentally show that the proposed algorithm can stabilize PINN training and yield performance competitive to the recent variants of PINNs trained with time adaptation.

📄 PDF Abstract BibTeX arXiv:2204.05108

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generative Ensemble Regression: Learning Particle Dynamics from Observations of Ensembles with Physics-Informed Deep Generative Models

2020-08-05 · Liu Yang, Constantinos Daskalakis, George Em. Karniadakis

We propose a new method for inferring the governing stochastic ordinary differential equations (SODEs) by observing particle ensembles at discrete and sparse time instants, i.e., multiple "snapshots". Particle coordinate…

regression

TS-PIELM: Time-Stepping Physics-Informed Extreme Learning Machine Facilitates Soil Consolidation Analyses

2025-06-10 · He Yang, Fei Ren, Hai-Sui Yu, Xueyu Geng 외

Accuracy and efficiency of the conventional physics-informed neural network (PINN) need to be improved before it can be a competitive alternative for soil consolidation analyses. This paper aims to overcome these limitat…

Computational EfficiencyPhysics-informed machine learning

Physics-Informed Learning of Proprietary Inverter Models for Grid Dynamic Studies

2025-07-21 · Kyung-Bin Kwon, Sayak Mukherjee, Ramij R. Hossain, Marcelo Elizondo arxiv

This letter develops a novel physics-informed neural ordinary differential equations-based framework to emulate the proprietary dynamics of the inverters -- essential for improved accuracy in grid dynamic simulations. In…

PSO-PINN: Physics-Informed Neural Networks Trained with Particle Swarm Optimization

2022-02-04 · Caio Davi, Ulisses Braga-Neto

Physics-informed neural networks (PINN) have recently emerged as a promising application of deep learning in a wide range of engineering and scientific problems based on partial differential equation (PDE) models. Howeve…

Multilevel physics informed neural networks (MPINNs)

2021-09-29 · Elisa Riccietti, Valentin Mercier, Serge Gratton, Pierre Boudier

In this paper we introduce multilevel physics informed neural networks (MPINNs). Inspired by classical multigrid methods for the solution of linear systems arising from the discretization of PDEs, our MPINNs are based on…