paper-with-me

Papers

Error Analysis of Kernel/GP Methods for Nonlinear and Parametric PDEs

2023-05-08 · Pau Batlle, Yifan Chen, Bamdad Hosseini, Houman Owhadi, Andrew M Stuart

We introduce a priori Sobolev-space error estimates for the solution of nonlinear, and possibly parametric, PDEs using Gaussian process and kernel based methods. The primary assumptions are: (1) a continuous embedding of the reproducing kernel Hilbert space of the kernel into a Sobolev space of sufficient regularity; and (2) the stability of the differential operator and the solution map of the PDE between corresponding Sobolev spaces. The proof is articulated around Sobolev norm error estimates for kernel interpolants and relies on the minimizing norm property of the solution. The error estimates demonstrate dimension-benign convergence rates if the solution space of the PDE is smooth enough. We illustrate these points with applications to high-dimensional nonlinear elliptic PDEs and parametric PDEs. Although some recent machine learning methods have been presented as breaking the curse of dimensionality in solving high-dimensional PDEs, our analysis suggests a more nuanced picture: there is a trade-off between the regularity of the solution and the presence of the curse of dimensionality. Therefore, our results are in line with the understanding that the curse is absent when the solution is regular enough.

📄 PDF Abstract BibTeX arXiv:2305.04962

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Regularized Kernel Recursive Least Square Algoirthm

2015-08-28 · Songlin Zhao

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their ada…

Kernel-based guarantees for nonlinear parametric models in Bayesian optimization

2026-05-13 · Rafael Oliveira arxiv

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses lar…

Gaussian Processes

Nonparametric Canonical Correlation Analysis

2015-11-16 · Tomer Michaeli, Weiran Wang, Karen Livescu

Canonical correlation analysis (CCA) is a classical representation learning technique for finding correlated variables in multi-view data. Several nonlinear extensions of the original linear CCA have been proposed, inclu…

Representation Learning

Neural-Kernelized Conditional Density Estimation

2018-06-05 · Hiroaki Sasaki, Aapo Hyvärinen

Conditional density estimation is a general framework for solving various problems in machine learning. Among existing methods, non-parametric and/or kernel-based methods are often difficult to use on large datasets, whi…

Density EstimationDimensionality ReductionRepresentation Learning

Stacked Kernel Network

2017-11-25 · Shuai Zhang, Jian-Xin Li, Pengtao Xie, Yingchun Zhang 외

Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hilbert Space (RKHS) while making the compu…