paper-with-me

홈 › Papers

Self-Conditioned Generative Adversarial Networks for Image Editing

2022-02-08 · Yunzhe Liu, Rinon Gal, Amit H. Bermano, Baoquan Chen, Daniel Cohen-Or

Generative Adversarial Networks (GANs) are susceptible to bias, learned from either the unbalanced data, or through mode collapse. The networks focus on the core of the data distribution, leaving the tails - or the edges of the distribution - behind. We argue that this bias is responsible not only for fairness concerns, but that it plays a key role in the collapse of latent-traversal editing methods when deviating away from the distribution's core. Building on this observation, we outline a method for mitigating generative bias through a self-conditioning process, where distances in the latent-space of a pre-trained generator are used to provide initial labels for the data. By fine-tuning the generator on a re-sampled distribution drawn from these self-labeled data, we force the generator to better contend with rare semantic attributes and enable more realistic generation of these properties. We compare our models to a wide range of latent editing methods, and show that by alleviating the bias they achieve finer semantic control and better identity preservation through a wider range of transformations. Our code and models will be available at https://github.com/yzliu567/sc-gan

📄 PDF Abstract BibTeX arXiv:2202.04040

Code (1)

yzliu567/sc-gan 공식 구현 pytorch

Tasks

Fairness

Similar Papers 제목 키워드 기반

Image Generation and Editing with Variational Info Generative AdversarialNetworks

2017-01-17 · Mahesh Gorijala, Ambedkar Dukkipati

Recently there has been an enormous interest in generative models for images in deep learning. In pursuit of this, Generative Adversarial Networks (GAN) and Variational Auto-Encoder (VAE) have surfaced as two most promin…

Image Generation

LatentKeypointGAN: Controlling Images via Latent Keypoints -- Extended Abstract

2022-05-06 · Xingzhe He, Bastian Wandt, Helge Rhodin

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditi…

SemFaceEdit: Semantic Face Editing on Generative Radiance Manifolds

2025-06-28 · Shashikant Verma, Shanmuganathan Raman

Despite multiple view consistency offered by 3D-aware GAN techniques, the resulting images often lack the capacity for localized editing. In response, generative radiance manifolds emerge as an efficient approach for con…

Disentanglement

KV Inversion: KV Embeddings Learning for Text-Conditioned Real Image Action Editing

2023-09-28 · Jiancheng Huang, Yifan Liu, Jin Qin, Shifeng Chen

Text-conditioned image editing is a recently emerged and highly practical task, and its potential is immeasurable. However, most of the concurrent methods are unable to perform action editing, i.e. they can not produce r…

SemanticAdv: Generating Adversarial Examples via Attribute-conditioned Image Editing

2020-08-01 · ECCV 2020 8 · Haonan Qiu, Chaowei Xiao, Lei Yang, Xinchen Yan 외

Deep neural networks (DNNs) have achieved great successes in various vision applications due to their strong expressive power. However, recent studies have shown that DNNs are vulnerable to adversarial examples which are…

Adversarial AttackAttributeFace RecognitionSemantic Segmentation