paper-with-me

Papers

Gaussianization Flows

2020-03-04 · Chenlin Meng, Yang song, Jiaming Song, Stefano Ermon

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both efficient computation of likelihoods and efficient inversion for sample generation. We demonstrate that these models, named Gaussianization flows, are universal approximators for continuous probability distributions under some regularity conditions. Because of this guaranteed expressivity, they can capture multimodal target distributions without compromising the efficiency of sample generation. Experimentally, we show that Gaussianization flows achieve better or comparable performance on several tabular datasets compared to other efficiently invertible flow models such as Real NVP, Glow and FFJORD. In particular, Gaussianization flows are easier to initialize, demonstrate better robustness with respect to different transformations of the training data, and generalize better on small training sets.

📄 PDF Abstract BibTeX arXiv:2003.01941

Code (3)

chenlin9/Gaussianization_Flows 공식 구현 pytorch
IPL-UV/gaussflow pytorch
IPL-UV/rbig_jax jax

Methods 이 논문이 사용한 방법론

Invertible 1x1 Convolution The Invertible 1x1 Convolution is a type of convolution used in flow-based generative models that reverses the ordering of…
Batch Normalization 설명 없음
RealNVP RealNVP is a generative model that utilises real-valued non-volume preserving (real NVP) transformations for density estimation. The model can perform efficient and exact…
Activation Normalization Activation Normalization is a type of normalization used for flow-based generative models; specifically it was introduced in the GLOW
Affine Coupling 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
GLOW 설명 없음

Similar Papers 제목 키워드 기반

Joint Manifold Learning and Density Estimation Using Normalizing Flows

2022-06-07 · Seyedeh Fatemeh Razavi, Mohammad Mahdi Mehmanchi, Reshad Hosseini, Mostafa Tavassolipour

Based on the manifold hypothesis, real-world data often lie on a low-dimensional manifold, while normalizing flows as a likelihood-based generative model are incapable of finding this manifold due to their structural con…

Density Estimation

Information Theory in Density Destructors

2020-12-02 · J. Emmanuel Johnson, Valero Laparra, Gustau Camps-Valls, Raul Santos-Rodríguez 외

Density destructors are differentiable and invertible transforms that map multivariate PDFs of arbitrary structure (low entropy) into non-structured PDFs (maximum entropy). Multivariate Gaussianization and multivariate e…

Iterative Gaussianization: from ICA to Random Rotations

2016-01-31 · IEEE Transactions on Neural Networks 2011 2 · Valero Laparra, Gustavo Camps-Valls, Jesús Malo

Most signal processing problems involve the challenging task of multidimensional probability density function (PDF) estimation. In this work, we propose a solution to this problem by using a family of Rotation-based Iter…

DenoisingImage Generation

Attenuation of Seismic Random Noise With Unknown Distribution: A Gaussianization Framework

2023-07-25 · IEEE Transactions on Geoscience and Remote Sensing 2023 7 · Chuangji Meng, Jinghuai Gao, Yajun Tian, Liang Zhao 외

Random noise attenuation is a critical step in seismic data processing. Since the distribution of field noise is complex and unknown, this poses a challenge to noise attenuation methods where the default noise distributi…

DenoisingGeophysics

Wasserstein Gaussianization and Efficient Variational Bayes for Robust Bayesian Synthetic Likelihood

2023-05-24 · Nhat-Minh Nguyen, Minh-Ngoc Tran, Christopher Drovandi, David Nott

The Bayesian Synthetic Likelihood (BSL) method is a widely-used tool for likelihood-free Bayesian inference. This method assumes that some summary statistics are normally distributed, which can be incorrect in many appli…

Bayesian Inference