paper-with-me

Papers

A Data-Adaptive Prior for Bayesian Learning of Kernels in Operators

2022-12-29 · Neil K. Chada, Quanjun Lang, Fei Lu, Xiong Wang

Kernels are efficient in representing nonlocal dependence and they are widely used to design operators between function spaces. Thus, learning kernels in operators from data is an inverse problem of general interest. Due to the nonlocal dependence, the inverse problem can be severely ill-posed with a data-dependent singular inversion operator. The Bayesian approach overcomes the ill-posedness through a non-degenerate prior. However, a fixed non-degenerate prior leads to a divergent posterior mean when the observation noise becomes small, if the data induces a perturbation in the eigenspace of zero eigenvalues of the inversion operator. We introduce a data-adaptive prior to achieve a stable posterior whose mean always has a small noise limit. The data-adaptive prior's covariance is the inversion operator with a hyper-parameter selected adaptive to data by the L-curve method. Furthermore, we provide a detailed analysis on the computational practice of the data-adaptive prior, and demonstrate it on Toeplitz matrices and integral operators. Numerical tests show that a fixed prior can lead to a divergent posterior mean in the presence of any of the four types of errors: discretization error, model error, partial observation and wrong noise assumption. In contrast, the data-adaptive prior always attains posterior means with small noise limits.

📄 PDF Abstract BibTeX arXiv:2212.14163

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Local Kernels that Approximate Bayesian Regularization and Proximal Operators

2018-03-09 · Frank Ong, Peyman Milanfar, Pascal Getreuer

In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations of Bayesian regularized least squares, …

global-optimizationvalid

Learning Nonparametric Volterra Kernels with Gaussian Processes

2021-06-10 · NeurIPS 2021 12 · Magnus Ross, Michael T. Smith, Mauricio A. Álvarez

This paper introduces a method for the nonparametric Bayesian learning of nonlinear operators, through the use of the Volterra series with kernels represented using Gaussian processes (GPs), which we term the nonparametr…

Gaussian ProcessesNumerical IntegrationregressionVariational Inference

Nearest Neighbor Dirichlet Mixtures

2020-03-17 · Shounak Chattopadhyay, Antik Chakraborty, David B. Dunson

There is a rich literature on Bayesian methods for density estimation, which characterize the unknown density as a mixture of kernels. Such methods have advantages in terms of providing uncertainty quantification in esti…

Density EstimationUncertainty Quantification

Data adaptive RKHS Tikhonov regularization for learning kernels in operators

2022-03-08 · Fei Lu, Quanjun Lang, Qingci An

We present DARTR: a Data Adaptive RKHS Tikhonov Regularization method for the linear inverse problem of nonparametric learning of function parameters in operators. A key ingredient is a system intrinsic data-adaptive (SI…

Adaptive Kernel Design for Bayesian Optimization Is a Piece of CAKE with LLMs

2025-09-22 · Richard Cornelius Suwandi, Feng Yin, Juntao Wang, Renjie Li 외 arxiv

The efficiency of Bayesian optimization (BO) relies heavily on the choice of the Gaussian process (GP) kernel, which plays a central role in balancing exploration and exploitation under limited evaluation budgets. Tradit…

Hyperparameter Optimization