Disentangled Representation Learning for 3D Face Shape
In this paper, we present a novel strategy to design disentangled 3D face shape representation. Specifically, a given 3D face shape is decomposed into identity part and expression part, which are both encoded and decoded in a nonlinear way. To solve this problem, we propose an attribute decomposition framework for 3D face mesh. To better represent face shapes which are usually nonlinear deformed between each other, the face shapes are represented by a vertex based deformation representation rather than Euclidean coordinates. The experimental results demonstrate that our method has better performance than existing methods on decomposing the identity and expression parts. Moreover, more natural expression transfer results can be achieved with our method than existing methods.
Code (1)
Tasks
AttributeRepresentation LearningSimilar Papers 제목 키워드 기반
Exploring 3D-aware Lifespan Face Aging via Disentangled Shape-Texture Representations
Existing face aging methods often focus on modeling either texture aging or using an entangled shape-texture representation to achieve face aging. However, shape and texture are two distinct factors that mutually affect …
3D Face ReconstructionFace ReconstructionTexture SynthesisFaceShapeGene: A Disentangled Shape Representation for Flexible Face Image Editing
Existing methods for face image manipulation generally focus on editing the expression, changing some predefined attributes, or applying different filters. However, users lack the flexibility of controlling the shapes of…
Image Manipulation3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces
Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is …
DisentanglementLearning Disentangled Representations via Independent Subspaces
Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled …
DisentanglementSemantic SegmentationUnsupervised Shape and Pose Disentanglement for 3D Meshes
Parametric models of humans, faces, hands and animals have been widely used for a range of tasks such as image-based reconstruction, shape correspondence estimation, and animation. Their key strength is the ability to fa…
DisentanglementPose TransferRetrieval