paper-with-me

홈 › Papers

Navigating the GAN Parameter Space for Semantic Image Editing

2020-11-27 · CVPR 2021 1 · Anton Cherepkov, Andrey Voynov, Artem Babenko

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for controllable generation since their latent spaces contain a wide range of interpretable directions, well suited for semantic editing operations. By gradually changing latent codes along these directions, one can produce impressive visual effects, unattainable without GANs. In this paper, we significantly expand the range of visual effects achievable with the state-of-the-art models, like StyleGAN2. In contrast to existing works, which mostly operate by latent codes, we discover interpretable directions in the space of the generator parameters. By several simple methods, we explore this space and demonstrate that it also contains a plethora of interpretable directions, which are an excellent source of non-trivial semantic manipulations. The discovered manipulations cannot be achieved by transforming the latent codes and can be used to edit both synthetic and real images. We release our code and models and hope they will serve as a handy tool for further efforts on GAN-based image editing.

📄 PDF Abstract BibTeX arXiv:2011.13786

Code (2)

yandex-research/navigan 공식 구현 pytorch
quickjkee/eff-diff-edit pytorch

Tasks

Image RestorationImage-to-Image TranslationTranslation

Methods 이 논문이 사용한 방법론

HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
Path Length Regularization 설명 없음
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
Weight Demodulation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
StyleGAN2 StyleGAN2 is a generative adversarial network that builds on StyleGAN with several improvements. First, [adaptive instance…

Similar Papers 제목 키워드 기반

Semantic Latent Decomposition with Normalizing Flows for Face Editing

2023-09-11 · Binglei Li, Zhizhong Huang, Hongming Shan, Junping Zhang

Navigating in the latent space of StyleGAN has shown effectiveness for face editing. However, the resulting methods usually encounter challenges in complicated navigation due to the entanglement among different attribute…

PIE: Portrait Image Embedding for Semantic Control

2020-09-20 · Ayush Tewari, Mohamed Elgharib, Mallikarjun B R., Florian Bernard 외

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to c…

Face Model

Fashion Style Editing with Generative Human Prior

2024-04-02 · Chaerin Kong, Seungyong Lee, Soohyeok Im, Wonsuk Yang

Image editing has been a long-standing challenge in the research community with its far-reaching impact on numerous applications. Recently, text-driven methods started to deliver promising results in domains like human f…

UniSpace: Unified Visual Representation and Scalable Multimodal Modeling

2026-08-09 · Jinbo Yan, Limeng Qiao, Jie Qin, Junyan He 외 hf

Semantic vision encoders have become a central visual interface for multimodal understanding and semantic conditioning in image generation. However, their final tokens discard fine-grained visual details, leading to poor…

Text-to-Image GenerationImage ReconstructionImage Editing

FastEdit: Fast Text-Guided Single-Image Editing via Semantic-Aware Diffusion Fine-Tuning

2024-08-06 · Zhi Chen, Zecheng Zhao, Yadan Luo, Zi Huang

Conventional Text-guided single-image editing approaches require a two-step process, including fine-tuning the target text embedding for over 1K iterations and the generative model for another 1.5K iterations. Although i…

parameter-efficient fine-tuningStyle Transfer