paper-with-me

홈 › Papers

Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Space

2020-09-14 · Jonas Wulff, Antonio Torralba

Modern Generative Adversarial Networks are capable of creating artificial, photorealistic images from latent vectors living in a low-dimensional learned latent space. It has been shown that a wide range of images can be projected into this space, including images outside of the domain that the generator was trained on. However, while in this case the generator reproduces the pixels and textures of the images, the reconstructed latent vectors are unstable and small perturbations result in significant image distortions. In this work, we propose to explicitly model the data distribution in latent space. We show that, under a simple nonlinear operation, the data distribution can be modeled as Gaussian and therefore expressed using sufficient statistics. This yields a simple Gaussian prior, which we use to regularize the projection of images into the latent space. The resulting projections lie in smoother and better behaved regions of the latent space, as shown using interpolation performance for both real and generated images. Furthermore, the Gaussian model of the distribution in latent space allows us to investigate the origins of artifacts in the generator output, and provides a method for reducing these artifacts while maintaining diversity of the generated images.

📄 PDF Abstract BibTeX arXiv:2009.06529

Code (0)

등록된 구현이 없습니다.

Tasks

Diversity

Similar Papers 제목 키워드 기반

Transforming the Latent Space of StyleGAN for Real Face Editing

2021-05-29 · Heyi Li, Jinlong Liu, Xinyu Zhang, Yunzhi Bai 외

Despite recent advances in semantic manipulation using StyleGAN, semantic editing of real faces remains challenging. The gap between the $W$ space and the $W$+ space demands an undesirable trade-off between reconstructio…

Diversity

Face Generation and Editing with StyleGAN: A Survey

2022-12-18 · Andrew Melnik, Maksim Miasayedzenkau, Dzianis Makarovets, Dzianis Pirshtuk 외

Our goal with this survey is to provide an overview of the state of the art deep learning methods for face generation and editing using StyleGAN. The survey covers the evolution of StyleGAN, from PGGAN to StyleGAN3, and …

Deep LearningFace GenerationFace SwappingStyle Transfer+1

ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing

2023-01-31 · Bingchuan Li, Tianxiang Ma, Peng Zhang, Miao Hua 외

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into it…

Image Generation

AE-StyleGAN: Improved Training of Style-Based Auto-Encoders

2021-10-17 · Ligong Han, Sri Harsha Musunuri, Martin Renqiang Min, Ruijiang Gao 외

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an en…

Third Time's the Charm? Image and Video Editing with StyleGAN3

2022-01-31 · Yuval Alaluf, Or Patashnik, Zongze Wu, Asif Zamir 외

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 arc…

DisentanglementImage GenerationVideo Editing