paper-with-me

홈 › Papers

The Fourier Spectral Transformer Networks For Efficient and Generalizable Nonlinear PDEs Prediction

2025-07-08 · Beibei Li arxiv

In this work we propose a unified Fourier Spectral Transformer network that integrates the strengths of classical spectral methods and attention based neural architectures. By transforming the original PDEs into spectral ordinary differential equations, we use high precision numerical solvers to generate training data and use a Transformer network to model the evolution of the spectral coefficients. We demonstrate the effectiveness of our approach on the two dimensional incompressible Navier-Stokes equations and the one dimensional Burgers' equation. The results show that our spectral Transformer can achieve highly accurate long term predictions even with limited training data, better than traditional numerical methods and machine learning methods in forecasting future flow dynamics. The proposed framework generalizes well to unseen data, bringing a promising paradigm for real time prediction and control of complex dynamical systems.

📄 PDF Abstract BibTeX arXiv:2507.05584

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs

2026-06-26 · Alex Colagrande, Paul Caillon, Eva Feillet, Alexandre Allauzen arxiv

Neural operators provide deep neural networks for learning mappings between function spaces. Among them, the Fourier Neural Operator (FNO) is particularly effective: its spectral convolution relies on low-dimensional Fou…

SAOT: An Enhanced Locality-Aware Spectral Transformer for Solving PDEs

2025-11-24 · Chenhong Zhou, Jie Chen, Zaifeng Yang arxiv

Neural operators have shown great potential in solving a family of Partial Differential Equations (PDEs) by modeling the mappings between input and output functions. Fourier Neural Operator (FNO) implements global convol…

SGNO: Spectral Generator Neural Operators for Stable Long Horizon PDE Rollouts

2026-02-21 · Jiayi Li, Penghao Jiang, Hira Saleem, Zhaonan Wang 외 arxiv

Autoregressive neural PDE surrogates predict future states by repeatedly applying a learned one-step operator. This is a simple and widely used method, but small one-step errors can accumulate during long rollouts. The r…

Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features

2026-08-06 · Yulun Wu, Matthieu Barreau, Miguel Aguiar, Karl H. Johansson arxiv

Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions, as well as strongly nonlinear problems. Two factors underlie t…

Representation Learning

An Inverse Scattering Inspired Fourier Neural Operator for Time-Dependent PDE Learning

2025-12-22 · Rixin Yu arxiv

Learning accurate and stable time-advancement operators for nonlinear partial differential equations (PDEs) remains challenging, particularly for chaotic, stiff, and long-horizon dynamical systems. While neural operator …