paper-with-me

홈 › Papers

Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs

2026-05-29 · Qihong Yang, Qiaolin He arxiv

Solving high-frequency partial differential equations (PDEs) with neural networks is notoriously difficult due to the spectral bias of conventional architectures. We propose the Multi-Scale Separable Fourier Neural Network (MS-SFNN), a framework designed to overcome this limitation by explicitly encoding multi-scale Fourier features within a separable representation. The network factorizes the solution into $d$ single-coordinate subnetworks with fixed, randomly initialized weights; these subnetworks are combined via element-wise products to form a rich set of basis functions. This separable construction scales linearly with the problem dimension, thus inherently alleviating the curse of dimensionality. Crucially, each subnetwork is equipped with trainable scaling factors coupled with cosine activations, providing an adaptive mechanism for multi-scale frequency selection that endows the model with strong spectral approximation capability. The PDE solution is expressed as a linear combination of these learned basis functions, and the combination coefficients are determined by solving a large-scale least-squares system. To resolve the memory bottleneck in high-frequency or three-dimensional settings, we replace automatic differentiation (AD) with analytical derivatives of the basis functions and use a memory-efficient batched QR decomposition for solving the least-squares systems efficiently. Extensive numerical experiments demonstrate that MS-SFNN achieves superior accuracy and substantially outperforms state-of-the-art methods, including Physics-Informed Neural Network (PINN) and the Separated-Variable Spectral Neural Network (SV-SNN).

📄 PDF Abstract BibTeX arXiv:2605.31027

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Depthwise-STFT based separable Convolutional Neural Networks

2020-01-27 · Sudhakar Kumawat, Shanmuganathan Raman

In this paper, we propose a new convolutional layer called Depthwise-STFT Separable layer that can serve as an alternative to the standard depthwise separable convolutional layer. The construction of the proposed layer i…

image-classificationImage ClassificationPosition

Frequency-adaptive tensor neural networks for high-dimensional multi-scale problems

2025-08-21 · Jizu Huang, Yue Qiu, Rukang You arxiv

Tensor neural networks (TNNs) have demonstrated their superiority in solving high-dimensional problems. However, similar to conventional neural networks, TNNs are also influenced by the Frequency Principle, which limits …

Neural-HSS: Hierarchical Semi-Separable Neural PDE Solver

2026-02-20 · Pietro Sittoni, Emanuele Zangrando, Angelo A. Casulli, Nicola Guglielmi 외 arxiv

Deep learning-based methods have shown remarkable effectiveness in solving PDEs, largely due to their ability to enable fast simulations once trained. However, despite the availability of high-performance computing infra…

Fourier Learning Machines: Nonharmonic Fourier-Based Neural Networks for Scientific Machine Learning

2025-09-10 · Mominul Rubel, Adam Meyers, Gabriel Nicolosi arxiv

We introduce the Fourier Learning Machine (FLM), a neural network (NN) architecture designed to represent a multidimensional nonharmonic Fourier series. The FLM uses a simple feedforward structure with cosine activation …

Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs

2022-11-28 · Robert Joseph George, Jiawei Zhao, Jean Kossaifi, Zongyi Li 외

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-conve…