Towards Deeper Understanding of Variational Autoencoding Models
We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and formally show that common issues such as blurry samples and uninformative latent features arise when these conditions are not met. Based on these new insights, we propose a new sequential VAE model that can generate sharp samples on the LSUN image dataset based on pixel-wise reconstruction loss, and propose an optimization criterion that encourages unsupervised learning of informative latent features.
Code (2)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Autoencoding Variational Inference for Aspect-based Opinion Summary
Aspect-based Opinion Summary (AOS), consisting of aspect discovery and sentiment classification steps, has recently been emerging as one of the most crucial data mining tasks in e-commerce systems. Along this direction, …
General ClassificationSentiment AnalysisSentiment ClassificationTopic Models+1AVT: Unsupervised Learning of Transformation Equivariant Representations by Autoencoding Variational Transformations
The learning of Transformation-Equivariant Representations (TERs), which is introduced by Hinton et al. \cite{hinton2011transforming}, has been considered as a principle to reveal visual structures under various transfor…
DecoderVariational decomposition autoencoding improves disentanglement of latent representations
Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the abil…
Representation LearningSpeech RecognitionSemi-supervised Parsing with a Variational Autoencoding Parser
We propose an end-to-end variational autoencoding parsing (VAP) model for semi-supervised graph-based projective dependency parsing. It encodes the input using continuous latent variables in a sequential manner by deep n…
Dependency ParsingWHAI: Weibull Hybrid Autoencoding Inference for Deep Topic Modeling
To train an inference network jointly with a deep generative topic model, making it both scalable to big corpora and fast in out-of-sample prediction, we develop Weibull hybrid autoencoding inference (WHAI) for deep late…