Demystifying Inter-Class Disentanglement
Learning to disentangle the hidden factors of variations within a set of observations is a key task for artificial intelligence. We present a unified formulation for class and content disentanglement and use it to illustrate the limitations of current methods. We therefore introduce LORD, a novel method based on Latent Optimization for Representation Disentanglement. We find that latent optimization, along with an asymmetric noise regularization, is superior to amortized inference for achieving disentangled representations. In extensive experiments, our method is shown to achieve better disentanglement performance than both adversarial and non-adversarial methods that use the same level of supervision. We further introduce a clustering-based approach for extending our method for settings that exhibit in-class variation with promising results on the task of domain translation.
Code (2)
Tasks
ClusteringDisentanglementTranslationUnsupervised Image-To-Image TranslationSimilar Papers 제목 키워드 기반
Demystifying Inductive Biases for $β$-VAE Based Architectures
The performance of $\beta$-Variational-Autoencoders ($\beta$-VAEs) and their variants on learning semantically meaningful, disentangled representations is unparalleled. On the other hand, there are theoretical arguments …
DisentanglementInductive BiasCommutativity and Disentanglement from the Manifold Perspective
In this paper, we interpret disentanglement as the discovery of local charts of the data manifold and trace how this definition naturally leads to an equivalent condition for disentanglement: commutativity between factor…
DisentanglementCoDeGAN: Contrastive Disentanglement for Generative Adversarial Network
Disentanglement, a critical concern in interpretable machine learning, has also garnered significant attention from the computer vision community. Many existing GAN-based class disentanglement (unsupervised) approaches, …
Contrastive LearningDisentanglementGenerative Adversarial NetworkInterpretable Machine LearningDemystifying Variational Diffusion Models
Despite the growing popularity of diffusion models, gaining a deep understanding of the model class remains somewhat elusive for the uninitiated in non-equilibrium statistical physics. With that in mind, we present what …
Unsupervised Representation Disentanglement of Text: An Evaluation on Synthetic Datasets
To highlight the challenges of achieving representation disentanglement for text domain in an unsupervised setting, in this paper we select a representative set of successfully applied models from the image domain. We ev…
DecoderDisentanglementInductive Bias