Disentangling by Factorising
We define and address the problem of unsupervised learning of disentangled representations on data generated from independent factors of variation. We propose FactorVAE, a method that disentangles by encouraging the distribution of representations to be factorial and hence independent across the dimensions. We show that it improves upon $\beta$-VAE by providing a better trade-off between disentanglement and reconstruction quality. Moreover, we highlight the problems of a commonly used disentanglement metric and introduce a new metric that does not suffer from them.
Code (17)
Tasks
DisentanglementSimilar Papers 제목 키워드 기반
Factorising AMR generation through syntax
Generating from Abstract Meaning Representation (AMR) is an underspecified problem, as many syntactic decisions are not constrained by the semantic graph. To explicitly account for this underspecification, we break down …
Abstract Meaning RepresentationDeep Learning for Audio Transcription on Low-Resource Datasets
In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal…
Deep LearningFactorising Meaning and Form for Intent-Preserving Paraphrasing
We propose a method for generating paraphrases of English questions that retain the original intent but use a different surface form. Our model combines a careful choice of training objective with a principled informatio…
DecoderFormParaphrase GenerationParaphrase IdentificationSuccesses and Limitations of Object-centric Models at Compositional Generalisation
In recent years, it has been shown empirically that standard disentangled latent variable models do not support robust compositional learning in the visual domain. Indeed, in spite of being designed with the goal of fact…
Learning Disentangling and Fusing Networks for Face Completion Under Structured Occlusions
Face completion aims to generate semantically new pixels for missing facial components. It is a challenging generative task due to large variations of face appearance. This paper studies generative face completion under …
DecoderFacial InpaintingGenerative Adversarial Network