Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View
From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate dimensions. To discover the factors and learn disentangled representation, previous methods typically leverage an extra regularization term when learning to generate realistic images. However, the term usually results in a trade-off between disentanglement and generation quality. For the generative models pretrained without any disentanglement term, the generated images show semantically meaningful variations when traversing along different directions in the latent space. Based on this observation, we argue that it is possible to mitigate the trade-off by $(i)$ leveraging the pretrained generative models with high generation quality, $(ii)$ focusing on discovering the traversal directions as factors for disentangled representation learning. To achieve this, we propose Disentaglement via Contrast (DisCo) as a framework to model the variations based on the target disentangled representations, and contrast the variations to jointly discover disentangled directions and learn disentangled representations. DisCo achieves the state-of-the-art disentangled representation learning and distinct direction discovering, given pretrained non-disentangled generative models including GAN, VAE, and Flow. Source code is at https://github.com/xrenaa/DisCo.
Code (2)
Tasks
Contrastive LearningDisentanglementRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Inductive-Biases for Contrastive Learning of Disentangled Representations
Learning disentangled representations is a core machine learning task. It has been shown that this task requires inductive biases. Recent work on class-content disentanglement has shown excellent performance, but require…
Contrastive LearningDisentanglementRepresentation LearningRetrieval+1Representation Disentanglement in Generative Models with Contrastive Learning
Contrastive learning has shown its effectiveness in image classification and generation. Recent works apply the contrastive learning on the discriminator of the Generative Adversarial Networks, and there exists little wo…
Contrastive LearningDisentanglementimage-classificationImage ClassificationDisentangling Properties of Contrastive Methods
Disentangled representation learning is an important topic in representation learning, since it not only allows the representation to be human interpretable, but it is also robust and benefits downstream task performance…
DisentanglementObject RecognitionRepresentation LearningA Temporally Disentangled Contrastive Diffusion Model for Spatiotemporal Imputation
Spatiotemporal data analysis is pivotal across various domains, such as transportation, meteorology, and healthcare. The data collected in real-world scenarios are often incomplete due to device malfunctions and network …
Contrastive LearningImputationMissing ValuesUnsupervised Disentanglement without Autoencoding: Pitfalls and Future Directions
Disentangled visual representations have largely been studied with generative models such as Variational AutoEncoders (VAEs). While prior work has focused on generative methods for disentangled representation learning, t…
Contrastive LearningDisentanglementRepresentation LearningSensitivity