paper-with-me

홈 › Papers

Multi-stage neural operator learning with application for convolutions

2026-08-19 · Zhiping Mao, Zhenye Wen, Yong Zhang, Xiaofei Zhao arxiv

Convolution integrals widely exist in applications, and to enable fast and accurate computations, this paper introduces two general multi-stage neural operator learning frameworks. The first, Deep Collocation Neural Operator (DCNO), is a supervised approach that iteratively refines the operator approximation by learning residuals from input-output data pairs. The second, Deep Galerkin Neural Operator (DGNO), is an unsupervised framework applicable when the target operator can be represented by a PDE, leveraging the weak form of the PDE residual for training. Both methods progressively construct basis operators through multiple training stages to enrich the approximation space, leading to significantly improved accuracy over standard one-shot operator learning. We provide theoretical analysis for their approximation capabilities and implement them for learning convolutions. Extensive numerical experiments demonstrate that both DCNO and DGNO achieve high accuracy, approaching machine precision under single float for convolution problems, and offer substantial efficiency gains for numerous queries or parametric variations compared to traditional solvers. We also extend these frameworks to handle multi-input operator learning scenarios involving variations in both the density and kernel of a convolution.

📄 PDF Abstract BibTeX arXiv:2608.18851

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Skeleton-Based Action Segmentation with Multi-Stage Spatial-Temporal Graph Convolutional Neural Networks

2022-02-03 · Benjamin Filtjens, Bart Vanrumste, Peter Slaets

The ability to identify and temporally segment fine-grained actions in motion capture sequences is crucial for applications in human movement analysis. Motion capture is typically performed with optical or inertial measu…

Action SegmentationSkeleton Based Action SegmentationTime SeriesTime Series Analysis

Multiscale Self Attentive Convolutions for Vision and Language Modeling

2019-12-03 · Oren Barkan

Self attention mechanisms have become a key building block in many state-of-the-art language understanding models. In this paper, we show that the self attention operator can be formulated in terms of 1x1 convolution ope…

Language ModelingLanguage Modelling

Neural Operators with Localized Integral and Differential Kernels

2024-02-26 · Miguel Liu-Schiaffini, Julius Berner, Boris Bonev, Thorsten Kurth 외

Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular a…

Operator learning

pathGCN: Learning General Graph Spatial Operators from Paths

2022-07-15 · Moshe Eliasof, Eldad Haber, Eran Treister

Graph Convolutional Networks (GCNs), similarly to Convolutional Neural Networks (CNNs), are typically based on two main operations - spatial and point-wise convolutions. In the context of GCNs, differently from CNNs, a p…

QuadConv: Quadrature-Based Convolutions with Applications to Non-Uniform PDE Data Compression

2022-11-09 · Kevin Doherty, Cooper Simpson, Stephen Becker, Alireza Doostan

We present a new convolution layer for deep learning architectures which we call QuadConv -- an approximation to continuous convolution via quadrature. Our operator is developed explicitly for use on non-uniform, mesh-ba…

Data Compression