paper-with-me

Papers

Learning Weighted Submanifolds with Variational Autoencoders and Riemannian Variational Autoencoders

2019-11-19 · CVPR 2020 6 · Nina Miolane, Susan Holmes

Manifold-valued data naturally arises in medical imaging. In cognitive neuroscience, for instance, brain connectomes base the analysis of coactivation patterns between different brain regions on the analysis of the correlations of their functional Magnetic Resonance Imaging (fMRI) time series - an object thus constrained by construction to belong to the manifold of symmetric positive definite matrices. One of the challenges that naturally arises consists of finding a lower-dimensional subspace for representing such manifold-valued data. Traditional techniques, like principal component analysis, are ill-adapted to tackle non-Euclidean spaces and may fail to achieve a lower-dimensional representation of the data - thus potentially pointing to the absence of lower-dimensional representation of the data. However, these techniques are restricted in that: (i) they do not leverage the assumption that the connectomes belong on a pre-specified manifold, therefore discarding information; (ii) they can only fit a linear subspace to the data. In this paper, we are interested in variants to learn potentially highly curved submanifolds of manifold-valued data. Motivated by the brain connectomes example, we investigate a latent variable generative model, which has the added benefit of providing us with uncertainty estimates - a crucial quantity in the medical applications we are considering. While latent variable models have been proposed to learn linear and nonlinear spaces for Euclidean data, or geodesic subspaces for manifold data, no intrinsic latent variable model exists to learn nongeodesic subspaces for manifold data. This paper fills this gap and formulates a Riemannian variational autoencoder with an intrinsic generative model of manifold-valued data. We evaluate its performances on synthetic and real datasets by introducing the formalism of weighted Riemannian submanifolds.

📄 PDF Abstract BibTeX arXiv:1911.08147

Code (0)

등록된 구현이 없습니다.

Tasks

Riemannian optimizationTime Series Analysis

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Variational Autoencoders with Riemannian Brownian Motion Priors

2020-02-12 · ICML 2020 1 · Dimitris Kalatzis, David Eklund, Georgios Arvanitidis, Søren Hauberg

Variational Autoencoders (VAEs) represent the given data in a low-dimensional latent space, which is generally assumed to be Euclidean. This assumption naturally leads to the common choice of a standard Gaussian prior ov…

Debiasing Evidence Approximations: On Importance-weighted Autoencoders and Jackknife Variational Inference

2018-01-01 · ICLR 2018 1 · Sebastian Nowozin

The importance-weighted autoencoder (IWAE) approach of Burda et al. defines a sequence of increasingly tighter bounds on the marginal likelihood of latent variable models. Recently, Cremer et al. reinterpreted the IWAE b…

Computational EfficiencyVariational Inference

Training Variational Autoencoders with Buffered Stochastic Variational Inference

2019-02-27 · Rui Shu, Hung H. Bui, Jay Whang, Stefano Ermon

The recognition network in deep latent variable models such as variational autoencoders (VAEs) relies on amortized inference for efficient posterior approximation that can scale up to large datasets. However, this techni…

Variational Inference

A Geometric Perspective on Variational Autoencoders

2022-09-15 · Clément Chadebec, Stéphanie Allassonnière

This paper introduces a new interpretation of the Variational Autoencoder framework by taking a fully geometric point of view. We argue that vanilla VAE models unveil naturally a Riemannian structure in their latent spac…

Mixed-curvature Variational Autoencoders

2019-11-19 · ICLR 2020 1 · Ondrej Skopek, Octavian-Eugen Ganea, Gary Bécigneul

Euclidean geometry has historically been the typical "workhorse" for machine learning applications due to its power and simplicity. However, it has recently been shown that geometric spaces with constant non-zero curvatu…