Diagonally Square Root Integrable Kernels in System Identification

2023-02-24 · Mohammad Khosravi, Roy S. Smith

In recent years, the reproducing kernel Hilbert space (RKHS) theory has played a crucial role in linear system identification. The core of a RKHS is the associated kernel characterizing its properties. Accordingly, this work studies the class of diagonally square root integrable (DSRI) kernels. We demonstrate that various well-known stable kernels introduced in system identification belong to this category. Moreover, it is shown that any DSRI kernel is also stable and integrable. We look into certain topological features of the RKHSs associated with DSRI kernels, particularly the continuity of linear operators defined on the respective RKHSs. For the stability of a Gaussian process centered at a stable impulse response, we show that the necessary and sufficient condition is the diagonally square root integrability of the corresponding kernel. Furthermore, we elaborate on this result by providing proper interpretations.

📄 PDF Abstract BibTeX arXiv:2302.12929

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

The Statistical Cost of Robust Kernel Hyperparameter Turning

2020-12-01 · NeurIPS 2020 12 · Raphael Meyer, Christopher Musco

This paper studies the statistical complexity of kernel hyperparameter tuning in the setting of active regression under adversarial noise. We consider the problem of finding the best interpolant from a class of kernels w…

Hyperparameter Optimization regression

Generalized Kernel Thinning

2021-10-04 · ICLR 2022 4 · Raaz Dwivedi, Lester Mackey

The kernel thinning (KT) algorithm of Dwivedi and Mackey (2021) compresses a probability distribution more effectively than independent sampling by targeting a reproducing kernel Hilbert space (RKHS) and leveraging a les…

The Statistical Cost of Robust Kernel Hyperparameter Tuning

2020-06-14 · Raphael A. Meyer, Christopher Musco

Hyperparameter Optimization regression

Strong Uniform Consistency with Rates for Kernel Density Estimators with General Kernels on Manifolds

2020-07-13 · Hau-Tieng Wu, Nan Wu

When analyzing modern machine learning algorithms, we may need to handle kernel density estimation (KDE) with intricate kernels that are not designed by the user and might even be irregular and asymmetric. To handle this…

Density Estimation

Deep Neural Networks: A Formulation Via Non-Archimedean Analysis

2024-01-31 · W. A. Zúñiga-Galindo

We introduce a new class of deep neural networks (DNNs) with multilayered tree-like architectures. The architectures are codified using numbers from the ring of integers of non-Archimdean local fields. These rings have a…