paper-with-me

Papers

Neural Operators with Localized Integral and Differential Kernels

2024-02-26 · Miguel Liu-Schiaffini, Julius Berner, Boris Bonev, Thorsten Kurth, Kamyar Azizzadenesheli, Anima Anandkumar

Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular architecture that performs global convolutions in the Fourier space. However, such global operations are often prone to over-smoothing and may fail to capture local details. In contrast, convolutional neural networks (CNN) can capture local features but are limited to training and inference at a single resolution. In this work, we present a principled approach to operator learning that can capture local features under two frameworks by learning differential operators and integral operators with locally supported kernels. Specifically, inspired by stencil methods, we prove that we obtain differential operators under an appropriate scaling of the kernel values of CNNs. To obtain local integral operators, we utilize suitable basis representations for the kernels based on discrete-continuous convolutions. Both these approaches preserve the properties of operator learning and, hence, the ability to predict at any resolution. Adding our layers to FNOs significantly improves their performance, reducing the relative L2-error by 34-72% in our experiments, which include a turbulent 2D Navier-Stokes and the spherical shallow water equations.

📄 PDF Abstract BibTeX arXiv:2402.16845

Code (2)

nvidia/torch-harmonics 공식 구현 pytorch
yzshi5/spl_ofm pytorch

Tasks

Operator learning

Similar Papers 제목 키워드 기반

SVD-NO: Learning PDE Solution Operators with SVD Integral Kernels

2025-11-13 · Noam Koren, Ralf J. J. Mackenbach, Ruud J. G. van Sloun, Kira Radinsky 외 arxiv

Neural operators have emerged as a promising paradigm for learning solution operators of partial differential equa- tions (PDEs) directly from data. Existing methods, such as those based on Fourier or graph techniques, m…

SFO: Learning PDE Operators via Spectral Filtering

2026-01-23 · Noam Koren, Rafael Moschopoulos, Kira Radinsky, Elad Hazan arxiv

Partial differential equations (PDEs) govern complex systems, yet neural operators often struggle to efficiently capture the long-range, nonlocal interactions inherent in their solution maps. We introduce Spectral Filter…

Coupled Multiwavelet Neural Operator Learning for Coupled Partial Differential Equations

2023-03-04 · Xiongye Xiao, Defu Cao, Ruochen Yang, Gaurav Gupta 외

Coupled partial differential equations (PDEs) are key tasks in modeling the complex dynamics of many physical processes. Recently, neural operators have shown the ability to solve PDEs by learning the integral kernel dir…

Operator learning

GIT-Net: Generalized Integral Transform for Operator Learning

2023-12-05 · Chao Wang, Alexandre Hoang Thiery

This article introduces GIT-Net, a deep neural network architecture for approximating Partial Differential Equation (PDE) operators, inspired by integral transform operators. GIT-NET harnesses the fact that differential …

Operator learning

How many moments does MMD compare?

2021-06-27 · Rustem Takhanov

We present a new way of study of Mercer kernels, by corresponding to a special kernel $K$ a pseudo-differential operator $p({\mathbf x}, D)$ such that $\mathcal{F} p({\mathbf x}, D)^\dag p({\mathbf x}, D) \mathcal{F}^{-1…