Multilinear Wavelets: A Statistical Shape Space for Human Faces
We present a statistical model for $3$D human faces in varying expression, which decomposes the surface of the face using a wavelet transform, and learns many localized, decorrelated multilinear models on the resulting coefficients. Using this model we are able to reconstruct faces from noisy and occluded $3$D face scans, and facial motion sequences. Accurate reconstruction of face shape is important for applications such as tele-presence and gaming. The localized and multi-scale nature of our model allows for recovery of fine-scale detail while retaining robustness to severe noise and occlusion, and is computationally efficient and scalable. We validate these properties experimentally on challenging data in the form of static scans and motion sequences. We show that in comparison to a global multilinear model, our model better preserves fine detail and is computationally faster, while in comparison to a localized PCA model, our model better handles variation in expression, is faster, and allows us to fix identity parameters for a given subject.
Code (1)
Tasks
3D Face Modelling3D Face ReconstructionFace ModelFace ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Groupwise Multilinear Correspondence Optimization for 3D Faces
Multilinear face models are widely used to model the space of human faces with expressions. For databases of 3D human faces of different identities performing multiple expressions, these statistical shape models decouple…
3D Face ModellingFace ModelA Robust Multilinear Model Learning Framework for 3D Faces
Multilinear models are widely used to represent the statistical variations of 3D human faces as they decouple shape changes due to identity and expression. Existing methods to learn a multilinear face model degrade if no…
3D Face ModellingFace ModelSemantic correspondenceA Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract
We present a multilinear statistical model of the human tongue that captures anatomical and tongue pose related shape variations separately. The model is derived from 3D magnetic resonance imaging data of 11 speakers sus…
DenoisingImage DenoisingImage SegmentationSemantic SegmentationBeyond Procrustes distances: a multilinear Gromov-Wasserstein distance capturing chirality
Efficiently and robustly analyzing shape data is critical across many scientific disciplines. While chirality is a fundamental property in numerous applications - most notably in molecular science - existing shape analys…
Learning the Multilinear Structure of Visual Data
Statistical decomposition methods are of paramount importance in discovering the modes of variations of visual data. Probably the most prominent linear decomposition method is the Principal Component Analysis (PCA), whic…
Tensor Decomposition