paper-with-me

Papers

VQ-Flows: Vector Quantized Local Normalizing Flows

2022-03-22 · Sahil Sidheekh, Chris B. Dock, Tushar Jain, Radu Balan, Maneesh K. Singh

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations in their expressivity when the data distribution is supported on a low-dimensional manifold or has a non-trivial topology. We introduce a novel statistical framework for learning a mixture of local normalizing flows as "chart maps" over the data manifold. Our framework augments the expressivity of recent approaches while preserving the signature property of normalizing flows, that they admit exact density evaluation. We learn a suitable atlas of charts for the data manifold via a vector quantized auto-encoder (VQ-AE) and the distributions over them using a conditional flow. We validate experimentally that our probabilistic framework enables existing approaches to better model data distributions over complex manifolds.

📄 PDF Abstract BibTeX arXiv:2203.11556

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Boosting Trust Region Policy Optimization by Normalizing Flows Policy

2018-09-27 · Yunhao Tang, Shipra Agrawal

We propose to improve trust region policy search with normalizing flows policy. We illustrate that when the trust region is constructed by KL divergence constraints, normalizing flows policy generates samples far from th…

Equivariant Finite Normalizing Flows

2021-10-16 · Avishek Joey Bose, Marcus Brubaker, Ivan Kobyzev

Generative modeling seeks to uncover the underlying factors that give rise to observed data that can often be modeled as the natural symmetries that manifest themselves through invariances and equivariances to certain tr…

Data-driven Modeling and Inference for Bayesian Gaussian Process ODEs via Double Normalizing Flows

2023-09-17 · Jian Xu, Shian Du, Junmei Yang, Xinghao Ding 외

Recently, Gaussian processes have been used to model the vector field of continuous dynamical systems, referred to as GPODEs, which are characterized by a probabilistic ODE equation. Bayesian inference for these models h…

Bayesian InferenceGaussian ProcessesTime SeriesTime Series Prediction

Sylvester Normalizing Flows for Variational Inference

2018-03-15 · Rianne van den Berg, Leonard Hasenclever, Jakub M. Tomczak, Max Welling

Variational inference relies on flexible approximate posterior distributions. Normalizing flows provide a general recipe to construct flexible variational posteriors. We introduce Sylvester normalizing flows, which can b…

Variational Inference

Flows for Flows: Training Normalizing Flows Between Arbitrary Distributions with Maximum Likelihood Estimation

2022-11-04 · Samuel Klein, John Andrew Raine, Tobias Golling

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow,…