paper-with-me

홈 › Papers

Training Invertible Neural Networks as Autoencoders

2023-03-20 · The-Gia Leo Nguyen, Lynton Ardizzone, Ullrich Köthe

Autoencoders are able to learn useful data representations in an unsupervised matter and have been widely used in various machine learning and computer vision tasks. In this work, we present methods to train Invertible Neural Networks (INNs) as (variational) autoencoders which we call INN (variational) autoencoders. Our experiments on MNIST, CIFAR and CelebA show that for low bottleneck sizes our INN autoencoder achieves results similar to the classical autoencoder. However, for large bottleneck sizes our INN autoencoder outperforms its classical counterpart. Based on the empirical results, we hypothesize that INN autoencoders might not have any intrinsic information loss and thereby are not bounded to a maximal number of layers (depth) after which only suboptimal results can be achieved.

📄 PDF Abstract BibTeX arXiv:2303.11239

Code (1)

xenovortex/training-invertible-neural-networks-as-autoencoders 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Deterministic training of generative autoencoders using invertible layers

2022-05-19 · Gianluigi Silvestri, Daan Roos, Luca Ambrogioni

In this work, we provide a deterministic alternative to the stochastic variational training of generative autoencoders. We refer to these new generative autoencoders as AutoEncoders within Flows (AEF), since the encoder …

DecoderDenoising

PIE: Pseudo-Invertible Encoder

2021-10-31 · ICLR 2019 5 · Jan Jetze Beitler, Ivan Sosnovik, Arnold Smeulders

We consider the problem of information compression from high dimensional data. Where many studies consider the problem of compression by non-invertible transformations, we emphasize the importance of invertible compressi…

Benchmarking Invertible Architectures on Inverse Problems

2021-01-26 · Jakob Kruse, Lynton Ardizzone, Carsten Rother, Ullrich Köthe

Recent work demonstrated that flow-based invertible neural networks are promising tools for solving ambiguous inverse problems. Following up on this, we investigate how ten invertible architectures and related models far…

Benchmarking

The Effects of Invertibility on the Representational Complexity of Encoders in Variational Autoencoders

2021-07-09 · ICML Workshop INNF 2021 7 · Divyansh Pareek, Andrej Risteski

Training and using modern neural-network based latent-variable generative models (like Variational Autoencoders) often require simultaneously training a generative direction along with an inferential(encoding) direction,…

DE-VAE: Revealing Uncertainty in Parametric and Inverse Projections with Variational Autoencoders using Differential Entropy

2025-08-16 · Frederik L. Dennig, Daniel A. Keim arxiv

Recently, autoencoders (AEs) have gained interest for creating parametric and invertible projections of multidimensional data. Parametric projections make it possible to embed new, unseen samples without recalculating th…