paper-with-me

홈 › Papers

FaceShapeGene: A Disentangled Shape Representation for Flexible Face Image Editing

2019-05-06 · Sen-Zhe Xu, Hao-Zhi Huang, Shi-Min Hu, Wei Liu

Existing methods for face image manipulation generally focus on editing the expression, changing some predefined attributes, or applying different filters. However, users lack the flexibility of controlling the shapes of different semantic facial parts in the generated face. In this paper, we propose an approach to compute a disentangled shape representation for a face image, namely the FaceShapeGene. The proposed FaceShapeGene encodes the shape information of each semantic facial part separately into a 1D latent vector. On the basis of the FaceShapeGene, a novel part-wise face image editing system is developed, which contains a shape-remix network and a conditional label-to-face transformer. The shape-remix network can freely recombine the part-wise latent vectors from different individuals, producing a remixed face shape in the form of a label map, which contains the facial characteristics of multiple subjects. The conditional label-to-face transformer, which is trained in an unsupervised cyclic manner, performs part-wise face editing while preserving the original identity of the subject. Experimental results on several tasks demonstrate that the proposed FaceShapeGene representation correctly disentangles the shape features of different semantic parts. %In addition, we test our system on several novel part-wise face editing tasks. Comparisons to existing methods demonstrate the superiority of the proposed method on accomplishing novel face editing tasks.

📄 PDF Abstract BibTeX arXiv:1905.01920

Code (0)

등록된 구현이 없습니다.

Tasks

Image Manipulation

Similar Papers 제목 키워드 기반

Disentangled Representation Learning for 3D Face Shape

2019-02-26 · CVPR 2019 6 · Zi-Hang Jiang, Qianyi Wu, Keyu Chen, Juyong Zhang

In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded…

AttributeRepresentation Learning

Exploring 3D-aware Lifespan Face Aging via Disentangled Shape-Texture Representations

2023-12-28 · Qianrui Teng, Rui Wang, Xing Cui, Peipei Li 외

Existing face aging methods often focus on modeling either texture aging or using an entangled shape-texture representation to achieve face aging. However, shape and texture are two distinct factors that mutually affect …

3D Face ReconstructionFace ReconstructionTexture Synthesis

3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces

2021-11-24 · CVPR 2022 1 · Simone Foti, Bongjin Koo, Danail Stoyanov, Matthew J. Clarkson

Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is …

Disentanglement

Learning Disentangled Representation for One-shot Progressive Face Swapping

2022-03-24 · Qi Li, Weining Wang, Chengzhong Xu, Zhenan Sun 외

Although face swapping has attracted much attention in recent years, it remains a challenging problem. Existing methods leverage a large number of data samples to explore the intrinsic properties of face swapping without…

AttributeDisentanglementFace Swapping

JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling

2024-12-29 · Haorui Ji, Rong Wang, Taojun Lin, Hongdong Li

Generative modeling of 3D human bodies have been studied extensively in computer vision. The core is to design a compact latent representation that is both expressive and semantically interpretable, yet existing approach…