paper-with-me

홈 › Papers

ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generation

2023-07-11 · Fadi Boutros, Marcel Klemt, Meiling Fang, Arjan Kuijper, Naser Damer

Deep generative models have recently presented impressive results in generating realistic face images of random synthetic identities. To generate multiple samples of a certain synthetic identity, previous works proposed to disentangle the latent space of GANs by incorporating additional supervision or regularization, enabling the manipulation of certain attributes. Others proposed to disentangle specific factors in unconditional pretrained GANs latent spaces to control their output, which also requires supervision by attribute classifiers. Moreover, these attributes are entangled in GAN's latent space, making it difficult to manipulate them without affecting the identity information. We propose in this work a framework, ExFaceGAN, to disentangle identity information in pretrained GANs latent spaces, enabling the generation of multiple samples of any synthetic identity. Given a reference latent code of any synthetic image and latent space of pretrained GAN, our ExFaceGAN learns an identity directional boundary that disentangles the latent space into two sub-spaces, with latent codes of samples that are either identity similar or dissimilar to a reference image. By sampling from each side of the boundary, our ExFaceGAN can generate multiple samples of synthetic identity without the need for designing a dedicated architecture or supervision from attribute classifiers. We demonstrate the generalizability and effectiveness of ExFaceGAN by integrating it into learned latent spaces of three SOTA GAN approaches. As an example of the practical benefit of our ExFaceGAN, we empirically prove that data generated by ExFaceGAN can be successfully used to train face recognition models (\url{https://github.com/fdbtrs/ExFaceGAN}).

📄 PDF Abstract BibTeX arXiv:2307.05151

Code (1)

fdbtrs/exfacegan 공식 구현 pytorch

Tasks

AttributeFace Recognition

Similar Papers 제목 키워드 기반

Latent-Identity Tuning in Text-to-Image Personalization Models

2026-07-13 · Daniel Garibi, Ronen Kamenetsky, Hadar Averbuch-Elor, Daniel Cohen-Or 외 hf

Generating and editing a person's face demands high precision, as even minor modifications can significantly alter a subject's perceived identity. Current personalization and editing methods built on general-purpose text…

Image Editing

Exploring Semantic Variations in GAN Latent Spaces via Matrix Factorization

2023-05-23 · Andrey Palaev, Rustam A. Lukmanov, Adil Khan

Controlled data generation with GANs is desirable but challenging due to the nonlinearity and high dimensionality of their latent spaces. In this work, we explore image manipulations learned by GANSpace, a state-of-the-a…

Disentanglement

Exploring Gradient-based Multi-directional Controls in GANs

2022-09-01 · Zikun Chen, Ruowei Jiang, Brendan Duke, Han Zhao 외

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-…

AttributeDisentanglementNavigate

Black Hole-Driven Identity Absorbing in Diffusion Models

2025-01-01 · CVPR 2025 1 · Muhammad Shaheryar, Jong Taek Lee, Soon Ki Jung

Recent advances in diffusion models have positioned them as powerful generative frameworks for high-resolution image synthesis across diverse domains. The emerging h-space within these models, defined by bottleneck a…

DisentanglementImage Generation

Rayleigh EigenDirections (REDs): GAN latent space traversals for multidimensional features

2022-01-25 · Guha Balakrishnan, Raghudeep Gadde, Aleix Martinez, Pietro Perona

We present a method for finding paths in a deep generative model's latent space that can maximally vary one set of image features while holding others constant. Crucially, unlike past traversal approaches, ours can manip…