paper-with-me

홈 › Papers

FEAT: Face Editing with Attention

2022-02-06 · Xianxu Hou, Linlin Shen, Or Patashnik, Daniel Cohen-Or, Hui Huang

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the generator. However, face manipulation often intends to affect local regions only, while common generators do not tend to have the necessary spatial disentanglement. In this paper, we build on the StyleGAN generator, and present a method that explicitly encourages face manipulation to focus on the intended regions by incorporating learned attention maps. During the generation of the edited image, the attention map serves as a mask that guides a blending between the original features and the modified ones. The guidance for the latent space edits is achieved by employing CLIP, which has recently been shown to be effective for text-driven edits. We perform extensive experiments and show that our method can perform disentangled and controllable face manipulations based on text descriptions by attending to the relevant regions only. Both qualitative and quantitative experimental results demonstrate the superiority of our method for facial region editing over alternative methods.

📄 PDF Abstract BibTeX arXiv:2202.02713

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglement

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
Adaptive Instance Normalization 설명 없음
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Reference-guided Face Component Editing

2020-06-03 · Qiyao Deng, Jie Cao, Yunfan Liu, Zhenhua Chai 외

Face portrait editing has achieved great progress in recent years. However, previous methods either 1) operate on pre-defined face attributes, lacking the flexibility of controlling shapes of high-level semantic facial c…

Image Inpainting

CAFE-GAN: Arbitrary Face Attribute Editing with Complementary Attention Feature

2020-11-24 · ECCV 2020 8 · Jeong-gi Kwak, David K. Han, Hanseok Ko

The goal of face attribute editing is altering a facial image according to given target attributes such as hair color, mustache, gender, etc. It belongs to the image-to-image domain transfer problem with a set of attribu…

AttributeGenerative Adversarial Network

FacEDiT: Unified Talking Face Editing and Generation via Facial Motion Infilling

2025-12-16 · Kim Sung-Bin, Joohyun Chang, David Harwath, Tae-Hyun Oh arxiv

Talking face editing and face generation have often been studied as distinct problems. In this work, we propose viewing both not as separate tasks but as subtasks of a unifying formulation, speech-conditional facial moti…

Talking Face Generation

Generative Adversarial Network with Spatial Attention for Face Attribute Editing

2018-09-01 · ECCV 2018 9 · Gang Zhang, Meina Kan, Shiguang Shan, Xilin Chen

Face attribute editing aims at editing the face image with the given attribute. Most existing works employ Generative Adversarial Network (GAN) to operate face attribute editing. However, these methods inevitably change…

AttributeData AugmentationFace RecognitionGenerative Adversarial Network

PA-GAN: Progressive Attention Generative Adversarial Network for Facial Attribute Editing

2020-07-12 · Zhenliang He, Meina Kan, Jichao Zhang, Shiguang Shan

Facial attribute editing aims to manipulate attributes on the human face, e.g., adding a mustache or changing the hair color. Existing approaches suffer from a serious compromise between correct attribute generation and …

AttributeGenerative Adversarial Network