paper-with-me

Papers

Linearization Turns Neural Operators into Function-Valued Gaussian Processes

2024-06-07 · Emilia Magnani, Marvin Pförtner, Tobias Weber, Philipp Hennig

Neural operators generalize neural networks to learn mappings between function spaces from data. They are commonly used to learn solution operators of parametric partial differential equations (PDEs) or propagators of time-dependent PDEs. However, to make them useful in high-stakes simulation scenarios, their inherent predictive error must be quantified reliably. We introduce LUNO, a novel framework for approximate Bayesian uncertainty quantification in trained neural operators. Our approach leverages model linearization to push (Gaussian) weight-space uncertainty forward to the neural operator's predictions. We show that this can be interpreted as a probabilistic version of the concept of currying from functional programming, yielding a function-valued (Gaussian) random process belief. Our framework provides a practical yet theoretically sound way to apply existing Bayesian deep learning methods such as the linearized Laplace approximation to neural operators. Just as the underlying neural operator, our approach is resolution-agnostic by design. The method adds minimal prediction overhead, can be applied post-hoc without retraining the network, and scales to large models and datasets. We evaluate these aspects in a case study on Fourier neural operators.

📄 PDF Abstract BibTeX arXiv:2406.05072

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesUncertainty Quantification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Generalized Interval-valued OWA Operators with Interval Weights Derived from Interval-valued Overlap Functions

2016-10-20 · Benjamin Bedregal, Humberto Bustince, Eduardo Palmeira, Graçaliz Pereira Dimuro 외

In this work we extend to the interval-valued setting the notion of an overlap functions and we discuss a method which makes use of interval-valued overlap functions for constructing OWA operators with interval-valued we…

Operator Learning Using Random Features: A Tool for Scientific Computing

2024-08-12 · Nicholas H. Nelsen, Andrew M. Stuart

Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scien…

Operator learningregression

Algebraic function based Banach space valued ordinary and fractional neural network approximations

2022-02-11 · George A Anastassiou

Here we research the univariate quantitative approximation, ordinary and fractional, of Banach space valued continuous functions on a compact interval or all the real line by quasi-interpolation Banach space valued neura…

Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingales

2024-04-04 · Ingo Steinwart

We investigate the conditional distributions of two Banach space valued, jointly Gaussian random variables. In particular, we show that these conditional distributions are again Gaussian and that their means and covarian…

Gaussian Processes

Belief revision and 3-valued logics: Characterization of 19,683 belief change operators

2019-10-30 · Nerio Borges, Ramón Pino Pérez

In most classical models of belief change, epistemic states are represented by theories (AGM) or formulas (Katsuno-Mendelzon) and the new pieces of information by formulas. The Representation Theorem for revision operato…