paper-with-me

Papers

LaDDer: Latent Data Distribution Modelling with a Generative Prior

2020-08-31 · Shuyu Lin, Ronald Clark

In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represent the inferred \textbf{latent data distribution}, i.e. its topology and structural properties. We propose LaDDer to achieve accurate modelling of the latent data distribution in a variational autoencoder framework and to facilitate better representation learning. The central idea of LaDDer is a meta-embedding concept, which uses multiple VAE models to learn an embedding of the embeddings, forming a ladder of encodings. We use a non-parametric mixture as the hyper prior for the innermost VAE and learn all the parameters in a unified variational framework. From extensive experiments, we show that our LaDDer model is able to accurately estimate complex latent distribution and results in improvement in the representation quality. We also propose a novel latent space interpolation method that utilises the derived data distribution.

📄 PDF Abstract BibTeX arXiv:2009.00088

Code (1)

lin-shuyu/ladder-latent-data-distribution-modelling 공식 구현 tf

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

USD Coin Customer Service Number +1-833-534-1729 설명 없음
Solana Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Ladder Variational Autoencoders

2016-02-06 · NeurIPS 2016 12 · Casper Kaae Sønderby, Tapani Raiko, Lars Maaløe, Søren Kaae Sønderby 외

Variational Autoencoders are powerful models for unsupervised learning. However deep models with several layers of dependent stochastic variables are difficult to train which limits the improvements obtained using these …

Unsupervised MNIST

PSLT: A Light-weight Vision Transformer with Ladder Self-Attention and Progressive Shift

2023-04-07 · Gaojie Wu, Wei-Shi Zheng, Yutong Lu, Qi Tian

Vision Transformer (ViT) has shown great potential for various visual tasks due to its ability to model long-range dependency. However, ViT requires a large amount of computing resource to compute the global self-attenti…

image-classificationImage ClassificationPerson Re-Identification

CaLFADS: latent factor analysis of dynamical systems in calcium imaging data

2021-01-01 · Luke Yuri Prince, Shahab Bakhtiari, Colleen J Gillon, Blake Aaron Richards

Dynamic latent variable modelling has been a hugely powerful tool in understanding how spiking activity in populations of neurons can perform computations necessary for adaptive behaviour. The success of such approaches …

Point Processes

Virtual Adversarial Ladder Networks For Semi-supervised Learning

2017-11-20 · Saki Shinoda, Daniel E. Worrall, Gabriel J. Brostow

Semi-supervised learning (SSL) partially circumvents the high cost of labeling data by augmenting a small labeled dataset with a large and relatively cheap unlabeled dataset drawn from the same distribution. This paper o…

Fast ABC with joint generative modelling and subset simulation

2021-04-16 · Eliane Maalouf, David Ginsbourger, Niklas Linde

We propose a novel approach for solving inverse-problems with high-dimensional inputs and an expensive forward mapping. It leverages joint deep generative modelling to transfer the original problem spaces to a lower dime…

DiagnosticDiversityGeophysics