paper-with-me

Papers

Riemannian statistics meets random matrix theory: towards learning from high-dimensional covariance matrices

2022-03-01 · Salem Said, Simon Heuveline, Cyrus Mostajeran

Riemannian Gaussian distributions were initially introduced as basic building blocks for learning models which aim to capture the intrinsic structure of statistical populations of positive-definite matrices (here called covariance matrices). While the potential applications of such models have attracted significant attention, a major obstacle still stands in the way of these applications: there seems to exist no practical method of computing the normalising factors associated with Riemannian Gaussian distributions on spaces of high-dimensional covariance matrices. The present paper shows that this missing method comes from an unexpected new connection with random matrix theory. Its main contribution is to prove that Riemannian Gaussian distributions of real, complex, or quaternion covariance matrices are equivalent to orthogonal, unitary, or symplectic log-normal matrix ensembles. This equivalence yields a highly efficient approximation of the normalising factors, in terms of a rather simple analytic expression. The error due to this approximation decreases like the inverse square of dimension. Numerical experiments are conducted which demonstrate how this new approximation can unlock the difficulties which have impeded applications to real-world datasets of high-dimensional covariance matrices. The paper then turns to Riemannian Gaussian distributions of block-Toeplitz covariance matrices. These are equivalent to yet another kind of random matrix ensembles, here called "acosh-normal" ensembles. Orthogonal and unitary "acosh-normal" ensembles correspond to the cases of block-Toeplitz with Toeplitz blocks, and block-Toeplitz (with general blocks) covariance matrices, respectively.

📄 PDF Abstract BibTeX arXiv:2203.00204

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

GeomNet: A Neural Network Based on Riemannian Geometries of SPD Matrix Space and Cholesky Space for 3D Skeleton-Based Interaction Recognition

2021-11-25 · ICCV 2021 10 · Xuan Son Nguyen

In this paper, we propose a novel method for representation and classification of two-person interactions from 3D skeleton sequences. The key idea of our approach is to use Gaussian distributions to capture statistics on…

Bayesian Optimization Meets Riemannian Manifolds in Robot Learning

2019-10-11 · Noémie Jaquier, Leonel Rozo, Sylvain Calinon, Mathias Bürger

Bayesian optimization (BO) recently became popular in robotics to optimize control parameters and parametric policies in direct reinforcement learning due to its data efficiency and gradient-free approach. However, its p…

Bayesian OptimizationReinforcement Learning

Universal characteristics of deep neural network loss surfaces from random matrix theory

2022-05-17 · Nicholas P Baskerville, Jonathan P Keating, Francesco Mezzadri, Joseph Najnudel 외

This paper considers several aspects of random matrix universality in deep neural networks. Motivated by recent experimental work, we use universal properties of random matrices related to local statistics to derive prac…

Understanding Matrix Function Normalizations in Covariance Pooling through the Lens of Riemannian Geometry

2024-07-15 · Ziheng Chen, Yue Song, Xiao-Jun Wu, Gaowen Liu 외

Global Covariance Pooling (GCP) has been demonstrated to improve the performance of Deep Neural Networks (DNNs) by exploiting second-order statistics of high-level representations. GCP typically performs classification o…

Financial Applications of Random Matrix Theory: a short review

2009-10-07 · J. P. Bouchaud, M. Potters

We discuss the applications of Random Matrix Theory in the context of financial markets and econometric models, a topic about which a considerable number of papers have been devoted to in the last decade. This mini-revie…