paper-with-me

홈 › Papers

In-Domain GAN Inversion for Real Image Editing

2020-03-31 · ECCV 2020 8 · Jiapeng Zhu, Yujun Shen, Deli Zhao, Bolei Zhou

Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing. A common practice of feeding a real image to a trained GAN generator is to invert it back to a latent code. However, existing inversion methods typically focus on reconstructing the target image by pixel values yet fail to land the inverted code in the semantic domain of the original latent space. As a result, the reconstructed image cannot well support semantic editing through varying the inverted code. To solve this problem, we propose an in-domain GAN inversion approach, which not only faithfully reconstructs the input image but also ensures the inverted code to be semantically meaningful for editing. We first learn a novel domain-guided encoder to project a given image to the native latent space of GANs. We then propose domain-regularized optimization by involving the encoder as a regularizer to fine-tune the code produced by the encoder and better recover the target image. Extensive experiments suggest that our inversion method achieves satisfying real image reconstruction and more importantly facilitates various image editing tasks, significantly outperforming start-of-the-arts.

📄 PDF Abstract BibTeX arXiv:2004.00049

Code (2)

genforce/idinvert tf
genforce/idinvert_pytorch pytorch

Tasks

Image Reconstruction

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversion

2023-01-28 · Pu Cao, Lu Yang, Dongxv Liu, Xiaoya Yang 외

Recently, inversion methods have focused on additional high-rate information in the generator (e.g., weights or intermediate features) to refine inversion and editing results from embedded latent codes. Although these te…

GAN Inversion for Out-of-Range Images with Geometric Transformations

2021-08-20 · ICCV 2021 10 · Kyoungkook Kang, Seongtae Kim, Sunghyun Cho

For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent code…

Make It So: Steering StyleGAN for Any Image Inversion and Editing

2023-04-27 · Anand Bhattad, Viraj Shah, Derek Hoiem, D. A. Forsyth

StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Ex…

Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editing

2024-12-15 · Jiancheng Huang, Yi Huang, Jianzhuang Liu, Donghao Zhou 외

Text-conditional image editing is a practical AIGC task that has recently emerged with great commercial and academic value. For real image editing, most diffusion model-based methods use DDIM Inversion as the first stage…

Null-text Inversion for Editing Real Images using Guided Diffusion Models

2022-11-17 · CVPR 2023 1 · Ron Mokady, Amir Hertz, Kfir Aberman, Yael Pritch 외

Recent text-guided diffusion models provide powerful image generation capabilities. Currently, a massive effort is given to enable the modification of these images using text only as means to offer intuitive and versatil…

Image GenerationText-based Image Editing