paper-with-me

홈 › Papers

When PINNs Go Wrong: Pseudo-Time Stepping Against Spurious Solutions

2026-04-26 · Sifan Wang, Shawn Koohy, Yiping Lu, Paris Perdikaris arxiv

Physics-informed neural networks (PINNs) provide a promising machine learning framework for solving partial differential equations, but their training often breaks down on challenging problems, sometimes converging to physically incorrect solutions despite achieving small residual losses. This failure, we argue, is not merely an optimization difficulty. Rather, it reflects a fundamental weakness of the empirical PDE residual loss, which can admit trivial or spurious solutions during training. From this perspective, we revisit pseudo-time stepping, a technique that has recently shown strong empirical success in PINNs. We show that its main benefit is not simply to ease optimization; instead, when combined with collocation-point resampling, it helps reveal and avoid spurious solutions. At the same time, we find that the effectiveness of pseudo-time stepping depends critically on the choice of step size, which cannot be tuned reliably from the training loss alone. To overcome this limitation, we propose an adaptive pseudo-time stepping strategy that selects the step size from a finite-difference surrogate of the local residual Jacobian, yielding the largest step permitted by local stability without per-problem tuning. Across a diverse set of PDE benchmarks, the proposed method consistently improves both accuracy and robustness. Together, these findings provide a clearer understanding of why PINNs fail and suggest a practical pathway toward more reliable physics-informed learning. All code and data accompanying this manuscript are available at https://github.com/sifanexisted/jaxpi2.

📄 PDF Abstract BibTeX arXiv:2604.23528

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

TSONN: Time-stepping-oriented neural network for solving partial differential equations

2023-10-25 · Wenbo Cao, Weiwei Zhang

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). Howe…

DAS-PINNs for high-dimensional partial differential equations: extending deep adaptive sampling to spacetime domains

2026-06-04 · Anshima Singh, David J. Silvester arxiv

Time-dependent high-dimensional partial differential equations (PDEs) with spatially localised and dynamically evolving solutions pose a fundamental challenge for physics-informed neural networks (PINNs), as uniform coll…

Transferable Physics-Informed Representations via Closed-Form Head Adaptation

2026-04-23 · Jian Cheng Wong, Isaac Yin Chung Lai, Pao-Hsiung Chiu, Chin Chun Ooi 외 arxiv

Physics-informed neural networks (PINNs) have garnered significant interest for their potential in solving partial differential equations (PDEs) that govern a wide range of physical phenomena. By incorporating physical l…

Multi-Task Learning

Improved Training of Physics-Informed Neural Networks with Model Ensembles

2022-04-11 · Katsiaryna Haitsiukevich, Alexander Ilin

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed dat…

Physics-Informed Neural Network Method for Solving One-Dimensional Advection Equation Using PyTorch

2021-03-15 · Shashank Reddy Vadyala, Sai Nethra Betgeri

Numerical solutions to the equation for advection are determined using different finite-difference approximations and physics-informed neural networks (PINNs) under conditions that allow an analytical solution. Their acc…