paper-with-me

홈 › Papers

Free-form Flows: Make Any Architecture a Normalizing Flow

2023-10-25 · Felix Draxler, Peter Sorrenson, Lea Zimmermann, Armand Rousselot, Ullrich Köthe

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure that uses an efficient estimator for the gradient of the change of variables formula. This enables any dimension-preserving neural network to serve as a generative model through maximum likelihood training. Our approach allows placing the emphasis on tailoring inductive biases precisely to the task at hand. Specifically, we achieve excellent results in molecule generation benchmarks utilizing $E(n)$-equivariant networks. Moreover, our method is competitive in an inverse problem benchmark, while employing off-the-shelf ResNet architectures.

📄 PDF Abstract BibTeX arXiv:2310.16624

Code (1)

vislearn/fff 공식 구현 pytorch

Tasks

Density EstimationForm

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Batch Normalization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Residual Connection 설명 없음
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…

Similar Papers 제목 키워드 기반

Whitening Convergence Rate of Coupling-based Normalizing Flows

2022-10-25 · Felix Draxler, Christoph Schnörr, Ullrich Köthe

Coupling-based normalizing flows (e.g. RealNVP) are a popular family of normalizing flow architectures that work surprisingly well in practice. This calls for theoretical understanding. Existing work shows that such flow…

Semi-Autoregressive Energy Flows: Exploring Likelihood-Free Training of Normalizing Flows

2022-06-14 · Phillip Si, Zeyi Chen, Subham Sekhar Sahoo, Yair Schiff 외

Training normalizing flow generative models can be challenging due to the need to calculate computationally expensive determinants of Jacobians. This paper studies the likelihood-free training of flows and proposes the e…

Two-sample testing

Continuous normalizing flows for lattice gauge theories

2024-10-17 · Mathis Gerdes, Pim de Haan, Roberto Bondesan, Miranda C. N. Cheng

Continuous normalizing flows are known to be highly expressive and flexible, which allows for easier incorporation of large symmetries and makes them a powerful tool for sampling in lattice field theories. Building on pr…

PINF: Continuous Normalizing Flows for Physics-Constrained Deep Learning

2023-09-26 · Feng Liu, Faguo Wu, Xiao Zhang

The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensu…

Deep Learning

Invertible Convolutional Flow

2019-12-01 · NeurIPS 2019 12 · Mahdi Karami, Dale Schuurmans, Jascha Sohl-Dickstein, Laurent Dinh 외

Normalizing flows can be used to construct high quality generative probabilistic models, but training and sample generation require repeated evaluation of Jacobian determinants and function inverses. To make such computa…