paper-with-me

홈 › Papers

Convergence guarantees for kernel-based quadrature rules in misspecified settings

2016-05-24 · NeurIPS 2016 12 · Motonobu Kanagawa, Bharath K. Sriperumbudur, Kenji Fukumizu

Kernel-based quadrature rules are becoming important in machine learning and statistics, as they achieve super-$\sqrt{n}$ convergence rates in numerical integration, and thus provide alternatives to Monte Carlo integration in challenging settings where integrands are expensive to evaluate or where integrands are high dimensional. These rules are based on the assumption that the integrand has a certain degree of smoothness, which is expressed as that the integrand belongs to a certain reproducing kernel Hilbert space (RKHS). However, this assumption can be violated in practice (e.g., when the integrand is a black box function), and no general theory has been established for the convergence of kernel quadratures in such misspecified settings. Our contribution is in proving that kernel quadratures can be consistent even when the integrand does not belong to the assumed RKHS, i.e., when the integrand is less smooth than assumed. Specifically, we derive convergence rates that depend on the (unknown) lesser smoothness of the integrand, where the degree of smoothness is expressed via powers of RKHSs or via Sobolev spaces.

📄 PDF Abstract BibTeX arXiv:1605.07254

Code (0)

등록된 구현이 없습니다.

Tasks

Numerical Integration

Similar Papers 제목 키워드 기반

Convergence Analysis of Deterministic Kernel-Based Quadrature Rules in Misspecified Settings

2017-09-01 · Motonobu Kanagawa, Bharath K. Sriperumbudur, Kenji Fukumizu

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test…

Towards a Unified Quadrature Framework for Large-Scale Kernel Machines

2020-11-03 · Fanghui Liu, Xiaolin Huang, Yudong Chen, Johan A. K. Suykens

In this paper, we develop a quadrature framework for large-scale kernel machines via a numerical integration representation. Considering that the integration domain and measure of typical kernels, e.g., Gaussian kernels,…

ARCNumerical Integration

Sparse solutions of the kernel herding algorithm by improved gradient approximation

2021-05-17 · Kazuma Tsuji, Ken'ichiro Tanaka

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are adv…

Computational Efficiency

Convergence Guarantees for Adaptive Bayesian Quadrature Methods

2019-05-24 · NeurIPS 2019 12 · Motonobu Kanagawa, Philipp Hennig

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical integration that empirically compares favorably with Monte Carlo integration on problems of medium dimensionality (where non-adaptive quadrature is n…

Numerical Integration

On the Equivalence between Kernel Quadrature Rules and Random Feature Expansions

2015-02-24 · Francis Bach

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kern…

valid