paper-with-me

Papers

Piecewise Normalizing Flows

2023-05-04 · Harry Bevins, Will Handley, Thomas Gessey-Jones

Normalizing flows are an established approach for modelling complex probability densities through invertible transformations from a base distribution. However, the accuracy with which the target distribution can be captured by the normalizing flow is strongly influenced by the topology of the base distribution. A mismatch between the topology of the target and the base can result in a poor performance, as is typically the case for multi-modal problems. A number of different works have attempted to modify the topology of the base distribution to better match the target, either through the use of Gaussian Mixture Models (Izmailov et al., 2020; Ardizzone et al., 2020; Hagemann & Neumayer, 2021) or learned accept/reject sampling (Stimper et al., 2022). We introduce piecewise normalizing flows which divide the target distribution into clusters, with topologies that better match the standard normal base distribution, and train a series of flows to model complex multi-modal targets. We demonstrate the performance of the piecewise flows using some standard benchmarks and compare the accuracy of the flows to the approach taken in Stimper et al. (2022) for modelling multi-modal distributions. We find that our approach consistently outperforms the approach in Stimper et al. (2022) with a higher emulation accuracy on the standard benchmarks.

📄 PDF Abstract BibTeX arXiv:2305.02930

Code (1)

htjb/margarine 공식 구현 tf

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
BASE 설명 없음

Similar Papers 제목 키워드 기반

Constructive approximate transport maps with normalizing flows

2024-12-26 · Antonio Álvarez-López, Borjan Geshkovski, Domènec Ruiz-Balet

We study an approximate controllability problem for the continuity equation and its application to constructing transport maps with normalizing flows. Specifically, we construct time-dependent controls $\theta=(w, a, b)$…

Analytic Bijections for Smooth and Interpretable Normalizing Flows

2026-01-15 · Mathis Gerdes, Miranda C. N. Cheng arxiv

A key challenge in normalizing flows is finding expressive invertible scalar bijections. Existing approaches face trade-offs: affine transformations are smooth and analytically invertible but lack expressivity; monotonic…

Sylvester Normalizing Flows for Variational Inference

2018-03-15 · Rianne van den Berg, Leonard Hasenclever, Jakub M. Tomczak, Max Welling

Variational inference relies on flexible approximate posterior distributions. Normalizing flows provide a general recipe to construct flexible variational posteriors. We introduce Sylvester normalizing flows, which can b…

Variational Inference

Flows for Flows: Training Normalizing Flows Between Arbitrary Distributions with Maximum Likelihood Estimation

2022-11-04 · Samuel Klein, John Andrew Raine, Tobias Golling

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow,…

Learning normalizing flows from Entropy-Kantorovich potentials

2020-06-10 · Chris Finlay, Augusto Gerolin, Adam M. Oberman, Aram-Alexandre Pooladian

We approach the problem of learning continuous normalizing flows from a dual perspective motivated by entropy-regularized optimal transport, in which continuous normalizing flows are cast as gradients of scalar potential…