Improving generative adversarial network inversion via fine-tuning GAN encoders
Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN inversion, they have limited performance and are not generalized to different GANs. To address these issues, we proposed a self-supervised method to pre-train and fine-tune GAN encoders. First, we designed an adaptive block to fit different encoder architectures for inverting diverse GANs. Then we pre-train GAN encoders using synthesized images and emphasize local regions through cropping images. Finally, we fine-tune the pre-trained GAN encoder for inverting real images. Compared with state-of-the-art methods, our method achieved better results that reconstructed high-quality images on mainstream GANs. Our code and pre-trained models are available at: https://github.com/disanda/Deep-GAN-Encoders.
Code (4)
Tasks
Generative Adversarial NetworkImage ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Performance of Machine Learning Methods for Gravity Inversion: Successes and Challenges
Gravity inversion is the problem of estimating subsurface density distributions from observed gravitational field data. We consider the two-dimensional (2D) case, in which recovering density models from one-dimensional (…
Dual Encoder GAN Inversion for High-Fidelity 3D Head Reconstruction from Single Images
3D GAN inversion aims to project a single image into the latent space of a 3D Generative Adversarial Network (GAN), thereby achieving 3D geometry reconstruction. While there exist encoders that achieve good results in 3D…
3D geometryGenerative Adversarial NetworkReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement
Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained …
Image GenerationReal-to-Cartoon translationImage Inversion: A Survey from GANs to Diffusion and Beyond
Image inversion is a fundamental task in generative models, aiming to map images back to their latent representations to enable downstream applications such as editing, restoration, and style transfer. This paper provide…
Generative Adversarial NetworkStyle TransferSurveyRobustness in Both Domains: CLIP Needs a Robust Text Encoder
Adversarial input attacks can cause a significant shift of CLIP embeddings. This can affect the downstream robustness of models incorporating CLIP in the pipeline, such as text-to-image generative models or large vision …