paper-with-me

홈 › Papers

Feature-Style Encoder for Style-Based GAN Inversion

2022-02-04 · Xu Yao, Alasdair Newson, Yann Gousseau, Pierre Hellier

We propose a novel architecture for GAN inversion, which we call Feature-Style encoder. The style encoder is key for the manipulation of the obtained latent codes, while the feature encoder is crucial for optimal image reconstruction. Our model achieves accurate inversion of real images from the latent space of a pre-trained style-based GAN model, obtaining better perceptual quality and lower reconstruction error than existing methods. Thanks to its encoder structure, the model allows fast and accurate image editing. Additionally, we demonstrate that the proposed encoder is especially well-suited for inversion and editing on videos. We conduct extensive experiments for several style-based generators pre-trained on different data domains. Our proposed method yields state-of-the-art results for style-based GAN inversion, significantly outperforming competing approaches. Source codes are available at https://github.com/InterDigitalInc/FeatureStyleEncoder .

📄 PDF Abstract BibTeX arXiv:2202.02183

Code (1)

interdigitalinc/featurestyleencoder 공식 구현 pytorch

Tasks

Image Reconstruction

Similar Papers 제목 키워드 기반

StylePrompter: All Styles Need Is Attention

2023-07-30 · Chenyi Zhuang, Pan Gao, Aljosa Smolic

GAN inversion aims at inverting given images into corresponding latent codes for Generative Adversarial Networks (GANs), especially StyleGAN where exists a disentangled latent space that allows attribute-based image mani…

AllAttributeImage Manipulation

AE-StyleGAN: Improved Training of Style-Based Auto-Encoders

2021-10-17 · Ligong Han, Sri Harsha Musunuri, Martin Renqiang Min, Ruijiang Gao 외

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an en…

Designing a 3D-Aware StyleNeRF Encoder for Face Editing

2023-02-19 · Songlin Yang, Wei Wang, Bo Peng, Jing Dong

GAN inversion has been exploited in many face manipulation tasks, but 2D GANs often fail to generate multi-view 3D consistent images. The encoders designed for 2D GANs are not able to provide sufficient 3D information fo…

AttributeFace ModelVideo Editing

ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement

2021-04-06 · ICCV 2021 10 · Yuval Alaluf, Or Patashnik, Daniel Cohen-Or

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained …

Image GenerationReal-to-Cartoon translation

HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing

2021-11-30 · CVPR 2022 1 · Yuval Alaluf, Omer Tov, Ron Mokady, Rinon Gal 외

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reco…