paper-with-me

Papers

DNA-GAN: Learning Disentangled Representations from Multi-Attribute Images

2017-11-15 · ICLR 2018 1 · Taihong Xiao, Jiapeng Hong, Jinwen Ma

Disentangling factors of variation has become a very challenging problem on representation learning. Existing algorithms suffer from many limitations, such as unpredictable disentangling factors, poor quality of generated images from encodings, lack of identity information, etc. In this paper, we propose a supervised learning model called DNA-GAN which tries to disentangle different factors or attributes of images. The latent representations of images are DNA-like, in which each individual piece (of the encoding) represents an independent factor of the variation. By annihilating the recessive piece and swapping a certain piece of one latent representation with that of the other one, we obtain two different representations which could be decoded into two kinds of images with the existence of the corresponding attribute being changed. In order to obtain realistic images and also disentangled representations, we further introduce the discriminator for adversarial training. Experiments on Multi-PIE and CelebA datasets finally demonstrate that our proposed method is effective for factors disentangling and even overcome certain limitations of the existing methods.

📄 PDF Abstract BibTeX arXiv:1711.05415

Code (1)

Prinsphield/DNA-GAN 공식 구현 tf

Tasks

AttributeRepresentation Learning

Similar Papers 제목 키워드 기반

DRIT++: Diverse Image-to-Image Translation via Disentangled Representations

2019-05-02 · Hsin-Ying Lee, Hung-Yu Tseng, Qi Mao, Jia-Bin Huang 외

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. …

AttributeDiversityImage-to-Image TranslationPerceptual Distance+1

Diverse Image-to-Image Translation via Disentangled Representations

2018-08-02 · ECCV 2018 9 · Hsin-Ying Lee, Hung-Yu Tseng, Jia-Bin Huang, Maneesh Kumar Singh 외

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single i…

AttributeDiversityDomain AdaptationImage-to-Image Translation+4

Attribute2Image: Conditional Image Generation from Visual Attributes

2015-12-02 · Xinchen Yan, Jimei Yang, Kihyuk Sohn, Honglak Lee

This paper investigates a novel problem of generating images from visual attributes. We model the image as a composite of foreground and background and develop a layered generative model with disentangled latent variable…

AttributeConditional Image GenerationImage GenerationImage Reconstruction

DualVAE: Controlling Colours of Generated and Real Images

2023-05-30 · Keerth Rathakumar, David Liebowitz, Christian Walder, Kristen Moore 외

Colour controlled image generation and manipulation are of interest to artists and graphic designers. Vector Quantised Variational AutoEncoders (VQ-VAEs) with autoregressive (AR) prior are able to produce high quality im…

Image Generation

Learning Disentangled Representations with Reference-Based Variational Autoencoders

2019-01-24 · Adria Ruiz, Oriol Martinez, Xavier Binefa, Jakob Verbeek

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically r…

AttributeConditional Image GenerationImage Generation