paper-with-me

Papers

Convergence Analysis of Deterministic Kernel-Based Quadrature Rules in Misspecified Settings

2017-09-01 · Motonobu Kanagawa, Bharath K. Sriperumbudur, Kenji Fukumizu

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test integrand is less smooth than a Sobolev RKHS based on which a quadrature rule is constructed. We provide convergence guarantees based on two different assumptions on a quadrature rule: one on quadrature weights, and the other on design points. More precisely, we show that convergence rates can be derived (i) if the sum of absolute weights remains constant (or does not increase quickly), or (ii) if the minimum distance between design points does not decrease very quickly. As a consequence of the latter result, we derive a rate of convergence for Bayesian quadrature in misspecified settings. We reveal a condition on design points to make Bayesian quadrature robust to misspecification, and show that, under this condition, it may adaptively achieve the optimal rate of convergence in the Sobolev space of a lesser order (i.e., of the unknown smoothness of a test integrand), under a slightly stronger regularity condition on the integrand.

📄 PDF Abstract BibTeX arXiv:1709.00147

Code (1)

motonobuk/kernel-quadrature 공식 구현

Similar Papers 제목 키워드 기반

Towards a Unified Quadrature Framework for Large-Scale Kernel Machines

2020-11-03 · Fanghui Liu, Xiaolin Huang, Yudong Chen, Johan A. K. Suykens

In this paper, we develop a quadrature framework for large-scale kernel machines via a numerical integration representation. Considering that the integration domain and measure of typical kernels, e.g., Gaussian kernels,…

ARCNumerical Integration

Sparse solutions of the kernel herding algorithm by improved gradient approximation

2021-05-17 · Kazuma Tsuji, Ken'ichiro Tanaka

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are adv…

Computational Efficiency

Convergence guarantees for kernel-based quadrature rules in misspecified settings

2016-05-24 · NeurIPS 2016 12 · Motonobu Kanagawa, Bharath K. Sriperumbudur, Kenji Fukumizu

Kernel-based quadrature rules are becoming important in machine learning and statistics, as they achieve super-$\sqrt{n}$ convergence rates in numerical integration, and thus provide alternatives to Monte Carlo integrati…

Numerical Integration

Optimally-Weighted Herding is Bayesian Quadrature

2012-04-07 · Ferenc Huszár, David Duvenaud

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the…

Optimally-Weighted Herding is Bayesian Quadrature

2014-08-09 · Ferenc Huszar, David Duvenaud

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the…