paper-with-me

홈 › Papers

Continuous normalizing flows on manifolds

2021-03-14 · Luca Falorsi

Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately, current approaches are only available for the most basic geometries and fall short when the underlying space has a nontrivial topology, limiting their applicability for most real-world data. Using fundamental ideas from differential geometry and geometric control theory, we describe how the recently introduced Neural ODEs and continuous normalizing flows can be extended to arbitrary smooth manifolds. We propose a general methodology for parameterizing vector fields on these spaces and demonstrate how gradient-based learning can be performed. Additionally, we provide a scalable unbiased estimator for the divergence in this generalized setting. Experiments on a diverse selection of spaces empirically showcase the defined framework's ability to obtain reparameterizable samples from complex distributions.

📄 PDF Abstract BibTeX arXiv:2104.14959

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Riemannian Continuous Normalizing Flows

2020-06-18 · NeurIPS 2020 12 · Emile Mathieu, Maximilian Nickel

Normalizing flows have shown great promise for modelling flexible probability distributions in a computationally tractable way. However, whilst data is often naturally described on Riemannian manifolds such as spheres, t…

Neural Manifold Ordinary Differential Equations

2020-06-18 · NeurIPS 2020 12 · Aaron Lou, Derek Lim, Isay Katsman, Leo Huang 외

To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed f…

Density Estimation

Principal Manifold Flows

2022-02-14 · Edmond Cunningham, Adam Cobb, Susmit Jha

Normalizing flows map an independent set of latent variables to their samples using a bijective transformation. Despite the exact correspondence between samples and latent variables, their high level relationship is not …

Density Estimation

Normalizing Flows on Riemannian Manifolds

2016-11-07 · Mevlana C. Gemici, Danilo Rezende, Shakir Mohamed

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular va…

Density EstimationProtein Folding

Neural Ordinary Differential Equations on Manifolds

2020-06-11 · Luca Falorsi, Patrick Forré

Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately current approaches fall short when the underlying space has a non trivial topology, …