paper-with-me

홈 › Papers

Attribute-specific Control Units in StyleGAN for Fine-grained Image Manipulation

2021-11-25 · Rui Wang, Jian Chen, Gang Yu, Li Sun, Changqian Yu, Changxin Gao, Nong Sang

Image manipulation with StyleGAN has been an increasing concern in recent years.Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images.However, due to the limited semantic and spatial manipulation precision in these latent spaces, the existing endeavors are defeated in fine-grained StyleGAN image manipulation, i.e., local attribute translation.To address this issue, we discover attribute-specific control units, which consist of multiple channels of feature maps and modulation styles. Specifically, we collaboratively manipulate the modulation style channels and feature maps in control units rather than individual ones to obtain the semantic and spatial disentangled controls. Furthermore, we propose a simple yet effective method to detect the attribute-specific control units. We move the modulation style along a specific sparse direction vector and replace the filter-wise styles used to compute the feature maps to manipulate these control units. We evaluate our proposed method in various face attribute manipulation tasks. Extensive qualitative and quantitative results demonstrate that our proposed method performs favorably against the state-of-the-art methods. The manipulation results of real images further show the effectiveness of our method.

📄 PDF Abstract BibTeX arXiv:2111.13010

Code (1)

budui/Control-Units-in-StyleGAN2 공식 구현 pytorch

Tasks

AttributeImage Manipulation

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Adaptive Instance Normalization 설명 없음
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…

Similar Papers 제목 키워드 기반

Perceptually Validated Precise Local Editing for Facial Action Units with StyleGAN

2021-07-26 · Alara Zindancıoğlu, T. Metin Sezgin

The ability to edit facial expressions has a wide range of applications in computer graphics. The ideal facial expression editing algorithm needs to satisfy two important criteria. First, it should allow precise and targ…

Example-Based Framework for Perceptually Guided Audio Texture Generation

2023-08-23 · Purnima Kamath, Chitralekha Gupta, Lonce Wyse, Suranga Nanayakkara

Controllable generation using StyleGANs is usually achieved by training the model using labeled data. For audio textures, however, there is currently a lack of large semantically labeled datasets. Therefore, to control g…

AttributeTexture Synthesis

StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows

2020-08-06 · Rameen Abdal, Peihao Zhu, Niloy Mitra, Peter Wonka

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still pres…

Attribute

PreciseControl: Enhancing Text-To-Image Diffusion Models with Fine-Grained Attribute Control

2024-07-24 · Rishubh Parihar, Sachidanand VS, Sabariswaran Mani, Tejan Karmali 외

Recently, we have seen a surge of personalization methods for text-to-image (T2I) diffusion models to learn a concept using a few images. Existing approaches, when used for face personalization, suffer to achieve convinc…

Attributecontinuous-controlContinuous Control

Unsupervised Facial Performance Editing via Vector-Quantized StyleGAN Representations

2023-01-01 · ICCV 2023 1 · Berkay Kicanaoglu, Pablo Garrido, Gaurav Bharaj

High-fidelity virtual human avatar applications create a need for photorealistic video face synthesis with controllable semantic editing over facial features. While recent generative neural methods have shown signifi…

Face GenerationFace ModelFace ReenactmentQuantization+1