paper-with-me

홈 › Papers

Neural-PDE: A RNN based neural network for solving time dependent PDEs

2020-09-08 · Yihao Hu, Tong Zhao, Shixin Xu, Zhiliang Xu, Lizhen Lin

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional finite difference and finite elements methods and emerging advancements in machine learning, we propose a sequence deep learning framework called Neural-PDE, which allows to automatically learn governing rules of any time-dependent PDE system from existing data by using a bidirectional LSTM encoder, and predict the next n time steps data. One critical feature of our proposed framework is that the Neural-PDE is able to simultaneously learn and simulate the multiscale variables.We test the Neural-PDE by a range of examples from one-dimensional PDEs to a high-dimensional and nonlinear complex fluids model. The results show that the Neural-PDE is capable of learning the initial conditions, boundary conditions and differential operators without the knowledge of the specific form of a PDE system.In our experiments the Neural-PDE can efficiently extract the dynamics within 20 epochs training, and produces accurate predictions. Furthermore, unlike the traditional machine learning approaches in learning PDE such as CNN and MLP which require vast parameters for model precision, Neural-PDE shares parameters across all time steps, thus considerably reduces the computational complexity and leads to a fast learning algorithm.

📄 PDF Abstract BibTeX arXiv:2009.03892

Code (1)

YihaoHu/Neural_PDE 공식 구현 tf

Tasks

BIG-bench Machine Learning

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Latent Neural Operator Pretraining for Solving Time-Dependent PDEs

2024-10-26 · Tian Wang, Chuang Wang

Pretraining methods gain increasing attraction recently for solving PDEs with neural operators. It alleviates the data scarcity problem encountered by neural operator learning when solving single PDE via training on larg…

Operator learning

Solving path dependent PDEs with LSTM networks and path signatures

2020-11-20

Using a combination of recurrent neural networks and signature methods from the rough paths theory we design efficient algorithms for solving parametric families of path dependent partial differential equations (PPDEs) t…

Multiscale Neural Operators for Solving Time-Independent PDEs

2023-11-10 · Winfried Ripken, Lisa Coiffard, Felix Pieper, Sebastian Dziadzio

Time-independent Partial Differential Equations (PDEs) on large meshes pose significant challenges for data-driven neural PDE solvers. We introduce a novel graph rewiring technique to tackle some of these challenges, suc…

Vectorized Conditional Neural Fields: A Framework for Solving Time-dependent Parametric Partial Differential Equations

2024-06-06 · Jan Hagnberger, Marimuthu Kalimuthu, Daniel Musekamp, Mathias Niepert

Transformer models are increasingly used for solving Partial Differential Equations (PDEs). Several adaptations have been proposed, all of which suffer from the typical problems of Transformers, such as quadratic memory …

Super-Resolution

Autoregression-Free Neural Operators for Time-Dependent PDEs

2026-05-25 · Jiaquan Zhang, Caiyan Qin, Haoyu Bian, Libin Cai 외 arxiv

Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs). For time-dependent PDEs, existing methods typically perform…