paper-with-me

홈 › Papers

Learning Hierarchical Priors in VAEs

2019-05-13 · NeurIPS 2019 12 · Alexej Klushyn, Nutan Chen, Richard Kurle, Botond Cseke, Patrick van der Smagt

We propose to learn a hierarchical prior in the context of variational autoencoders to avoid the over-regularisation resulting from a standard normal prior distribution. To incentivise an informative latent representation of the data, we formulate the learning problem as a constrained optimisation problem by extending the Taming VAEs framework to two-level hierarchical models. We introduce a graph-based interpolation method, which shows that the topology of the learned latent representation corresponds to the topology of the data manifold---and present several examples, where desired properties of latent representation such as smoothness and simple explanatory factors are learned by the prior.

📄 PDF Abstract BibTeX arXiv:1905.04982

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Diffusion Priors In Variational Autoencoders

2021-06-29 · ICML Workshop INNF 2021 7 · Antoine Wehenkel, Gilles Louppe

Among likelihood-based approaches for deep generative modelling, variational autoencoders (VAEs) offer scalable amortized posterior inference and fast sampling. However, VAEs are also more and more outperformed by compet…

Denoising

Nonparametric Variational Auto-encoders for Hierarchical Representation Learning

2017-03-21 · ICCV 2017 10 · Prasoon Goyal, Zhiting Hu, Xiaodan Liang, Chenyu Wang 외

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple…

ClusteringRepresentation LearningVariational Inference

Bayes-Factor-VAE: Hierarchical Bayesian Deep Auto-Encoder Models for Factor Disentanglement

2019-09-06 · ICCV 2019 10 · Minyoung Kim, Yuting Wang, Pritish Sahu, Vladimir Pavlovic

We propose a family of novel hierarchical Bayesian deep auto-encoder models capable of identifying disentangled factors of variability in data. While many recent attempts at factor disentanglement have focused on sophist…

Disentanglement

A Contrastive Learning Approach for Training Variational Autoencoder Priors

2020-10-06 · NeurIPS 2021 12 · Jyoti Aneja, Alexander Schwing, Jan Kautz, Arash Vahdat

Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in many domains. However, they struggle to generate high-quality images, especially when samples are obtained f…

Contrastive LearningImage Generation

NCP-VAE: Variational Autoencoders with Noise Contrastive Priors

2020-09-28 · Jyoti Aneja, Alex Schwing, Jan Kautz, Arash Vahdat

Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in various domains. However, they struggle to generate high-quality images, especially when samples are obtaine…