paper-with-me

홈 › Papers

Adversarial Learning of Disentangled and Generalizable Representations for Visual Attributes

2019-04-09 · James Oldfield, Yannis Panagakis, Mihalis A. Nicolaou

Recently, a multitude of methods for image-to-image translation have demonstrated impressive results on problems such as multi-domain or multi-attribute transfer. The vast majority of such works leverages the strengths of adversarial learning and deep convolutional autoencoders to achieve realistic results by well-capturing the target data distribution. Nevertheless, the most prominent representatives of this class of methods do not facilitate semantic structure in the latent space, and usually rely on binary domain labels for test-time transfer. This leads to rigid models, unable to capture the variance of each domain label. In this light, we propose a novel adversarial learning method that (i) facilitates the emergence of latent structure by semantically disentangling sources of variation, and (ii) encourages learning generalizable, continuous, and transferable latent codes that enable flexible attribute mixing. This is achieved by introducing a novel loss function that encourages representations to result in uniformly distributed class posteriors for disentangled attributes. In tandem with an algorithm for inducing generalizable properties, the resulting representations can be utilized for a variety of tasks such as intensity-preserving multi-attribute image translation and synthesis, without requiring labelled test data. We demonstrate the merits of the proposed method by a set of qualitative and quantitative experiments on popular databases such as MultiPIE, RaFD, and BU-3DFE, where our method outperforms other, state-of-the-art methods in tasks such as intensity-preserving multi-attribute transfer and synthesis.

📄 PDF Abstract BibTeX arXiv:1904.04772

Code (1)

james-oldfield/adv-attribute-disentanglement 공식 구현 tf

Tasks

AttributeImage-to-Image TranslationTranslation

Similar Papers 제목 키워드 기반

Scaling-up Disentanglement for Image Translation

2021-03-25 · ICCV 2021 10 · Aviv Gabbay, Yedid Hoshen

Image translation methods typically aim to manipulate a set of labeled attributes (given as supervision at training time e.g. domain label) while leaving the unlabeled attributes intact. Current methods achieve either: (…

DisentanglementDiversityTranslation

Geometry of Deep Generative Models for Disentangled Representations

2019-02-19 · Ankita Shukla, Shagun Uppal, Sarthak Bhagat, Saket Anand 외

Deep generative models like variational autoencoders approximate the intrinsic geometry of high dimensional data manifolds by learning low-dimensional latent-space variables and an embedding function. The geometric prope…

Representation Learning

Learning Disentangled Representations for Image Translation

2021-01-01 · Aviv Gabbay, Yedid Hoshen

Recent approaches for unsupervised image translation are strongly reliant on generative adversarial training and architectural locality constraints. Despite their appealing results, it can be easily observed that the lea…

DisentanglementDiversityTranslation

Attribute2Image: Conditional Image Generation from Visual Attributes

2015-12-02 · Xinchen Yan, Jimei Yang, Kihyuk Sohn, Honglak Lee

This paper investigates a novel problem of generating images from visual attributes. We model the image as a composite of foreground and background and develop a layered generative model with disentangled latent variable…

AttributeConditional Image GenerationImage GenerationImage Reconstruction

Unsupervised Domain-Specific Deblurring via Disentangled Representations

2019-03-05 · CVPR 2019 6 · Boyu Lu, Jun-Cheng Chen, Rama Chellappa

Image deblurring aims to restore the latent sharp images from the corresponding blurred ones. In this paper, we present an unsupervised method for domain-specific single-image deblurring based on disentangled representat…

DeblurringDisentanglementImage DeblurringSingle Image Deblurring