paper-with-me

Papers

Continuous-Time Flows for Efficient Inference and Density Estimation

2017-09-04 · ICML 2018 7 · Changyou Chen, Chunyuan Li, Liqun Chen, Wenlin Wang, Yunchen Pu, Lawrence Carin

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and generative adversarial networks (GANs), are often developed independently. In this paper, we propose the concept of {\em continuous-time flows} (CTFs), a family of diffusion-based methods that are able to asymptotically approach a target distribution. Distinct from normalizing flows and GANs, CTFs can be adopted to achieve the above two goals in one framework, with theoretical guarantees. Our framework includes distilling knowledge from a CTF for efficient inference, and learning an explicit energy-based distribution with CTFs for density estimation. Both tasks rely on a new technique for distribution matching within amortized learning. Experiments on various tasks demonstrate promising performance of the proposed CTF framework, compared to related techniques.

📄 PDF Abstract BibTeX arXiv:1709.01179

Code (0)

등록된 구현이 없습니다.

Tasks

Density Estimation

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Variational Inference with Continuously-Indexed Normalizing Flows

2020-07-10 · Anthony Caterini, Rob Cornish, Dino Sejdinovic, Arnaud Doucet

Continuously-indexed flows (CIFs) have recently achieved improvements over baseline normalizing flows on a variety of density estimation tasks. CIFs do not possess a closed-form marginal density, and so, unlike standard …

Bayesian InferenceDensity EstimationVariational Inference

OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transport

2020-05-29 · Derek Onken, Samy Wu Fung, Xingjian Li, Lars Ruthotto

A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows th…

Density Estimation

Lossless Compression using Continuously-Indexed Normalizing Flows

2021-03-04 · ICLR Workshop Neural_Compression 2021 5 · Adam Golinski, Anthony L. Caterini

Recently, a class of deep generative models known as continuously-indexed flows (CIFs) have expanding the modelling capacity of normalizing flows (NFs) in the context of both density estimation and variational inference.…

Density EstimationVariational Inference

Structured Neural Networks for Density Estimation and Causal Inference

2023-11-03 · NeurIPS 2023 11

Injecting structure into neural networks enables learning functions that satisfy invariances with respect to subsets of inputs. For instance, when learning generative models using neural networks, it is advantageous to e…

Causal InferencecounterfactualDensity Estimation

Building Normalizing Flows with Stochastic Interpolants

2022-09-30 · Michael S. Albergo, Eric Vanden-Eijnden

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dep…

BenchmarkingDensity EstimationImage Generation