U-NO: U-shaped Neural Operators
Neural operators generalize classical neural networks to maps between infinite-dimensional spaces, e.g., function spaces. Prior works on neural operators proposed a series of novel methods to learn such maps and demonstrated unprecedented success in learning solution operators of partial differential equations. Due to their close proximity to fully connected architectures, these models mainly suffer from high memory usage and are generally limited to shallow deep learning models. In this paper, we propose U-shaped Neural Operator (U-NO), a U-shaped memory enhanced architecture that allows for deeper neural operators. U-NOs exploit the problem structures in function predictions and demonstrate fast training, data efficiency, and robustness with respect to hyperparameters choices. We study the performance of U-NO on PDE benchmarks, namely, Darcy's flow law and the Navier-Stokes equations. We show that U-NO results in an average of 26% and 44% prediction improvement on Darcy's flow and turbulent Navier-Stokes equations, respectively, over the state of the art. On Navier-Stokes 3D spatiotemporal operator learning task, we show U-NO provides 37% improvement over the state of art methods.
Code (1)
Tasks
Operator learningSimilar Papers 제목 키워드 기반
Equivariant U-Shaped Neural Operators for the Cahn-Hilliard Phase-Field Model
Phase separation in binary mixtures, governed by the Cahn-Hilliard equation, plays a central role in interfacial dynamics across materials science and soft matter. While numerical solvers are accurate, they are often com…
Estimating Koopman operators for nonlinear dynamical systems: a nonparametric approach
The Koopman operator is a mathematical tool that allows for a linear description of non-linear systems, but working in infinite dimensional spaces. Dynamic Mode Decomposition and Extended Dynamic Mode Decomposition are a…
A vector logic for intensional formal semantics
Formal semantics and distributional semantics are distinct approaches to linguistic meaning: the former models meaning as reference via model-theoretic structures; the latter represents meaning as vectors in high-dimensi…
LoMix: Learnable Weighted Multi-Scale Logits Mixing for Medical Image Segmentation
U-shaped networks output logits at multiple spatial scales, each capturing a different blend of coarse context and fine detail. Yet, training still treats these logits in isolation - either supervising only the final, hi…
Medical Image SegmentationThe importance of dynamic risk constraints for limited liability operators
Previous literature shows that prevalent risk measures such as Value at Risk or Expected Shortfall are ineffective to curb excessive risk-taking by a tail-risk-seeking trader with S-shaped utility function in the context…