The GAN that Warped: Semantic Attribute Editing with Unpaired Data
Deep neural networks have recently been used to edit images with great success, in particular for faces. However, they are often limited to only being able to work at a restricted range of resolutions. Many methods are so flexible that face edits can often result in an unwanted loss of identity. This work proposes to learn how to perform semantic image edits through the application of smooth warp fields. Previous approaches that attempted to use warping for semantic edits required paired data, i.e. example images of the same subject with different semantic attributes. In contrast, we employ recent advances in Generative Adversarial Networks that allow our model to be trained with unpaired data. We demonstrate face editing at very high resolutions (4k images) with a single forward pass of a deep network at a lower resolution. We also show that our edits are substantially better at preserving the subject's identity. The robustness of our approach is demonstrated by showing plausible image editing results on the Cub200 birds dataset. To our knowledge this has not been previously accomplished, due the challenging nature of the dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
4kAttributeSimilar Papers 제목 키워드 기반
PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on
Image-based virtual try-on is one of the most promising applications of human-centric image generation due to its tremendous real-world potential. In this work, we take a step forwards to explore versatile virtual try-on…
DisentanglementImage GenerationVirtual Try-on3D-Aware Face Editing via Warping-Guided Latent Direction Learning
3D facial editing a longstanding task in computer vision with broad applications is expected to fast and intuitively manipulate any face from arbitrary viewpoints following the user's will. Existing works have limita…
AttributeFacial EditingSemantic Attribute Matching Networks
We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two task…
AttributeBootstrap Your Generator: Unpaired Visual Editing with Flow Matching
Modern generative models possess a deep understanding of visual content, yet training them for image editing typically requires massive datasets of paired examples. This limits scalability, especially for video editing w…
Image EditingSAT3D: Image-driven Semantic Attribute Transfer in 3D
GAN-based image editing task aims at manipulating image attributes in the latent space of generative models. Most of the previous 2D and 3D-aware approaches mainly focus on editing attributes in images with ambiguous sem…
AttributeReading Comprehension