paper-with-me

Papers

Discretely Indexed Flows

2022-04-04 · Elouan Argouarc'h, François Desbouvries, Eric Barat, Eiji Kawasaki, Thomas Dautremer

In this paper we propose Discretely Indexed flows (DIF) as a new tool for solving variational estimation problems. Roughly speaking, DIF are built as an extension of Normalizing Flows (NF), in which the deterministic transport becomes stochastic, and more precisely discretely indexed. Due to the discrete nature of the underlying additional latent variable, DIF inherit the good computational behavior of NF: they benefit from both a tractable density as well as a straightforward sampling scheme, and can thus be used for the dual problems of Variational Inference (VI) and of Variational density estimation (VDE). On the other hand, DIF can also be understood as an extension of mixture density models, in which the constant mixture weights are replaced by flexible functions. As a consequence, DIF are better suited for capturing distributions with discontinuities, sharp edges and fine details, which is a main advantage of this construction. Finally we propose a methodology for constructiong DIF in practice, and see that DIF can be sequentially cascaded, and cascaded with NF.

📄 PDF Abstract BibTeX arXiv:2204.01361

Code (1)

elouanargouarch/discretely-indexed-flows 공식 구현 pytorch

Tasks

Density EstimationVariational Inference

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Relaxing Bijectivity Constraints with Continuously Indexed Normalising Flows

2019-09-30 · ICML 2020 1 · Rob Cornish, Anthony L. Caterini, George Deligiannidis, Arnaud Doucet

We show that normalising flows become pathological when used to model targets whose supports have complicated topologies. In this scenario, we prove that a flow must become arbitrarily numerically noninvertible in order …

Density EstimationNormalising Flows

Variational Inference with Continuously-Indexed Normalizing Flows

2020-07-10 · Anthony Caterini, Rob Cornish, Dino Sejdinovic, Arnaud Doucet

Continuously-indexed flows (CIFs) have recently achieved improvements over baseline normalizing flows on a variety of density estimation tasks. CIFs do not possess a closed-form marginal density, and so, unlike standard …

Bayesian InferenceDensity EstimationVariational Inference

Measure-Theoretic Probability of Complex Co-occurrence and E-Integral

2022-10-18 · Jian-Yong Wang, Han Yu

Complex high-dimensional co-occurrence data are increasingly popular from a complex system of interacting physical, biological and social processes in discretely indexed modifiable areal units or continuously indexed loc…

Lossless Compression using Continuously-Indexed Normalizing Flows

2021-03-04 · ICLR Workshop Neural_Compression 2021 5 · Adam Golinski, Anthony L. Caterini

Recently, a class of deep generative models known as continuously-indexed flows (CIFs) have expanding the modelling capacity of normalizing flows (NFs) in the context of both density estimation and variational inference.…

Density EstimationVariational Inference

Time-changed normalizing flows for accurate SDE modeling

2023-12-22 · Naoufal El Bekri, Lucas Drumetz, Franck Vermet

The generative paradigm has become increasingly important in machine learning and deep learning models. Among popular generative models are normalizing flows, which enable exact likelihood estimation by transforming a ba…

Gaussian ProcessesTime Series