paper-with-me

Papers

Operator Learning Using Random Features: A Tool for Scientific Computing

2024-08-12 · Nicholas H. Nelsen, Andrew M. Stuart

Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing, which may often be framed in terms of operators mapping between spaces of functions. Building on the classical random features methodology for scalar regression, this paper introduces the function-valued random features method. This leads to a supervised operator learning architecture that is practical for nonlinear problems yet is structured enough to facilitate efficient training through the optimization of a convex, quadratic cost. Due to the quadratic structure, the trained model is equipped with convergence guarantees and error and complexity bounds, properties that are not readily available for most other operator learning architectures. At its core, the proposed approach builds a linear combination of random operators. This turns out to be a low-rank approximation of an operator-valued kernel ridge regression algorithm, and hence the method also has strong connections to Gaussian process regression. The paper designs function-valued random features that are tailored to the structure of two nonlinear operator learning benchmark problems arising from parametric partial differential equations. Numerical results demonstrate the scalability, discretization invariance, and transferability of the function-valued random features method.

📄 PDF Abstract BibTeX arXiv:2408.06526

Code (1)

nickhnelsen/random-features-banach 공식 구현

Tasks

Operator learningregression

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

OpenArray v1.0: a simple operator library for the decoupling of ocean modeling and parallel computing

2019-11-11 · Geoscientific Model Development 2019 11 · Xiaomeng Huang, Xing Huang, Dong Wang, Qi Wu 외

Rapidly evolving computational techniques are making a large gap between scientific aspiration and code implementation in climate modeling. In this work, we design a simple computing library to bridge the gap and decoupl…

CPU

Collapsing Taylor Mode Automatic Differentiation

2025-05-19 · Felix Dangel, Tim Siebert, Marius Zeinhofer, Andrea Walther

Computing partial differential equation (PDE) operators via nested backpropagation is expensive, yet popular, and severely restricts their utility for scientific machine learning. Recent advances, like the forward Laplac…

DeepSeek vs. ChatGPT: A Comparative Study for Scientific Computing and Scientific Machine Learning Tasks

2025-02-25 · Qile Jiang, Zhiwei Gao, George Em Karniadakis

Large Language Models (LLMs) have emerged as powerful tools for tackling a wide range of problems, including those in scientific computing, particularly in solving partial differential equations (PDEs). However, differen…

Operator learning

Operator-Valued Bochner Theorem, Fourier Feature Maps for Operator-Valued Kernels, and Vector-Valued Learning

2016-08-19 · Ha Quang Minh

This paper presents a framework for computing random operator-valued feature maps for operator-valued positive definite kernels. This is a generalization of the random Fourier features for scalar-valued kernels to the op…

Operator Learning: A Statistical Perspective

2025-04-04 · Unique Subedi, Ambuj Tewari

Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces. A primary application of operator learning is the development of surrogate…

Operator learningUncertainty Quantification