paper-with-me

Papers

Deep Diffeomorphic Normalizing Flows

2018-10-08 · Hadi Salman, Payman Yadollahpour, Tom Fletcher, Kayhan Batmanghelich

The Normalizing Flow (NF) models a general probability density by estimating an invertible transformation applied on samples drawn from a known distribution. We introduce a new type of NF, called Deep Diffeomorphic Normalizing Flow (DDNF). A diffeomorphic flow is an invertible function where both the function and its inverse are smooth. We construct the flow using an ordinary differential equation (ODE) governed by a time-varying smooth vector field. We use a neural network to parametrize the smooth vector field and a recursive neural network (RNN) for approximating the solution of the ODE. Each cell in the RNN is a residual network implementing one Euler integration step. The architecture of our flow enables efficient likelihood evaluation, straightforward flow inversion, and results in highly flexible density estimation. An end-to-end trained DDNF achieves competitive results with state-of-the-art methods on a suite of density estimation and variational inference tasks. Finally, our method brings concepts from Riemannian geometry that, we believe, can open a new research direction for neural density estimation.

📄 PDF Abstract BibTeX arXiv:1810.03256

Code (0)

등록된 구현이 없습니다.

Tasks

Density EstimationVariational Inference

Similar Papers 제목 키워드 기반

Neural Diffeomorphic Non-uniform B-spline Flows

2023-04-07 · Seongmin Hong, Se Young Chun

Normalizing flows have been successfully modeling a complex probability distribution as an invertible transformation of a simple base distribution. However, there are often applications that require more than invertibili…

Jacobian Determinant of Normalizing Flows

2021-02-12 · Huadong Liao, JiaWei He

Normalizing flows learn a diffeomorphic mapping between the target and base distribution, while the Jacobian determinant of that mapping forms another real-valued function. In this paper, we show that the Jacobian determ…

Time-changed normalizing flows for accurate SDE modeling

2023-12-22 · Naoufal El Bekri, Lucas Drumetz, Franck Vermet

The generative paradigm has become increasingly important in machine learning and deep learning models. Among popular generative models are normalizing flows, which enable exact likelihood estimation by transforming a ba…

Gaussian ProcessesTime Series

Denoising Normalizing Flow

2021-12-01 · NeurIPS 2021 12 · Christian Horvat, Jean-Pascal Pfister

Normalizing flows (NF) are expressive as well as tractable density estimation methods whenever the support of the density is diffeomorphic to the entire data-space. However, real-world data sets typically live on (or ver…

DenoisingDensity Estimation

Diffeomorphic Explanations with Normalizing Flows

2021-06-02 · ICML Workshop INNF 2021 7 · Ann-Kathrin Dombrowski, Jan E Gerken, Pan Kessel

Normalizing flows are diffeomorphisms which are parameterized by neural networks. As a result, they can induce coordinate transformations in the tangent space of the data manifold. In this work, we demonstrate that such …