paper-with-me

Papers

Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities

2025-01-11 · Jian Cheng Wong, Abhishek Gupta, Chin Chun Ooi, Pao-Hsiung Chiu, Jiao Liu, Yew-Soon Ong

Deep learning models trained on finite data lack a complete understanding of the physical world. On the other hand, physics-informed neural networks (PINNs) are infused with such knowledge through the incorporation of mathematically expressible laws of nature into their training loss function. By complying with physical laws, PINNs provide advantages over purely data-driven models in limited-data regimes and present as a promising route towards Physical AI. This feature has propelled them to the forefront of scientific machine learning, a domain characterized by scarce and costly data. However, the vision of accurate physics-informed learning comes with significant challenges. This work examines PINNs for the first time in terms of model optimization and generalization, shedding light on the need for new algorithmic advances to overcome issues pertaining to the training speed, precision, and generalizability of today's PINN models. Of particular interest are gradient-free evolutionary algorithms (EAs) for optimizing the uniquely complex loss landscapes arising in PINN training. Methods synergizing gradient descent and EAs for discovering bespoke neural architectures and balancing multiple terms in physics-informed learning objectives are positioned as important avenues for future research. Another exciting track is to cast evolutionary as a meta-learner of generalizable PINN models. To substantiate these proposed avenues, we further highlight results from recent literature to showcase the early success of such approaches in addressing the aforementioned challenges in PINN optimization and generalization.

📄 PDF Abstract BibTeX arXiv:2501.06572

Code (0)

등록된 구현이 없습니다.

Tasks

Evolutionary AlgorithmsModel OptimizationSurvey

Similar Papers 제목 키워드 기반

Evolutionary Optimization of Physics-Informed Neural Networks: Advancing Generalizability by the Baldwin Effect

2023-12-06 · Jian Cheng Wong, Chin Chun Ooi, Abhishek Gupta, Pao-Hsiung Chiu 외

Physics-informed neural networks (PINNs) are at the forefront of scientific machine learning, making possible the creation of machine intelligence that is cognizant of physical laws and able to accurately simulate them. …

Meta-Learning

Efficient Discrete Physics-informed Neural Networks for Addressing Evolutionary Partial Differential Equations

2023-12-22 · Siqi Chen, Bin Shan, Ye Li

Physics-informed neural networks (PINNs) have shown promising potential for solving partial differential equations (PDEs) using deep learning. However, PINNs face training difficulties for evolutionary PDEs, particularly…

Transfer Learning

Evolutionary Algorithm-Guided LLMs for Physics-Informed Neural Network Design

2026-07-17 · Xu Yang, Mingyang Yu, Jing Xu, Keqian Li arxiv

Physics-informed neural networks (PINNs) are unusually sensitive to interacting choices of architecture, activation, loss weighting, collocation, optimization, and constraint enforcement. Large language models (LLMs) can…

Evolutionary Two-Stage Hyperparameter Optimization Strategies for Physics-Informed Neural Networks

2026-06-18 · Fedor Buzaev, Dmitry Efremenko, Egor Bugaev, Andrei Ermakov 외 arxiv

Physics-Informed Neural Networks (PINNs) solve Partial Differential Equations (PDEs) by embedding physical laws into neural network training. However, their performance suffers from unstable convergence, training plateau…

Hyperparameter Optimization

NSGA-PINN: A Multi-Objective Optimization Method for Physics-Informed Neural Network Training

2023-03-03 · Binghang Lu, Christian B. Moya, Guang Lin

This paper presents NSGA-PINN, a multi-objective optimization framework for effective training of Physics-Informed Neural Networks (PINNs). The proposed framework uses the Non-dominated Sorting Genetic Algorithm (NSGA-II…