paper-with-me

홈 › Papers

Fast Flow Reconstruction via Robust Invertible nxn Convolution

2019-05-24 · Thanh-Dat Truong, Khoa Luu, Chi Nhan Duong, Ngan Le, Minh-Triet Tran

Flow-based generative models have recently become one of the most efficient approaches to model data generation. Indeed, they are constructed with a sequence of invertible and tractable transformations. Glow first introduced a simple type of generative flow using an invertible $1 \times 1$ convolution. However, the $1 \times 1$ convolution suffers from limited flexibility compared to the standard convolutions. In this paper, we propose a novel invertible $n \times n$ convolution approach that overcomes the limitations of the invertible $1 \times 1$ convolution. In addition, our proposed network is not only tractable and invertible but also uses fewer parameters than standard convolutions. The experiments on CIFAR-10, ImageNet and Celeb-HQ datasets, have shown that our invertible $n \times n$ convolution helps to improve the performance of generative models significantly.

📄 PDF Abstract BibTeX arXiv:1905.10170

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Invertible 1x1 Convolution The Invertible 1x1 Convolution is a type of convolution used in flow-based generative models that reverses the ordering of…
Activation Normalization Activation Normalization is a type of normalization used for flow-based generative models; specifically it was introduced in the GLOW…
Affine Coupling 설명 없음
Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…
GLOW 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

FInC Flow: Fast and Invertible $k \times k$ Convolutions for Normalizing Flows

2023-01-23 · Aditya Kallappa, Sandeep Nagar, Girish Varma

Invertible convolutions have been an essential element for building expressive normalizing flow-based generative models since their introduction in Glow. Several attempts have been made to design invertible $k \times k$ …

Image Generation

MintNet: Building Invertible Neural Networks with Masked Convolutions

2019-07-18 · NeurIPS 2019 12 · Yang Song, Chenlin Meng, Stefano Ermon

We propose a new way of constructing invertible neural networks by combining simple building blocks with a novel set of composition rules. This leads to a rich set of invertible architectures, including those similar to …

Image Generation

Trumpets: Injective Flows for Inference and Inverse Problems

2021-02-20 · Konik Kothari, AmirEhsan Khorashadizadeh, Maarten de Hoop, Ivan Dokmanić

We propose injective generative models called Trumpets that generalize invertible normalizing flows. The proposed generators progressively increase dimension from a low-dimensional latent space. We demonstrate that Trump…

Bayesian InferenceImage ReconstructionUncertainty Quantification

CInC Flow: Characterizable Invertible 3x3 Convolution

2021-07-03 · Sandeep Nagar, Marius Dufraisse, Girish Varma

Normalizing flows are an essential alternative to GANs for generative modelling, which can be optimized directly on the maximum likelihood of the dataset. They also allow computation of the exact latent vector correspond…

The Convolution Exponential and Generalized Sylvester Flows

2020-06-02 · NeurIPS 2020 12 · Emiel Hoogeboom, Victor Garcia Satorras, Jakub M. Tomczak, Max Welling

This paper introduces a new method to build linear flows, by taking the exponential of a linear transformation. This linear transformation does not need to be invertible itself, and the exponential has the following desi…