Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting
Large-pose face alignment is a very challenging problem in computer vision, which is used as a prerequisite for many important vision tasks, e.g, face recognition and 3D face reconstruction. Recently, there have been a few attempts to solve this problem, but still more research is needed to achieve highly accurate results. In this paper, we propose a face alignment method for large-pose face images, by combining the powerful cascaded CNN regressor method and 3DMM. We formulate the face alignment as a 3DMM fitting problem, where the camera projection matrix and 3D shape parameters are estimated by a cascade of CNN-based regressors. The dense 3D shape allows us to design pose-invariant appearance features for effective CNN learning. Extensive experiments are conducted on the challenging databases (AFLW and AFW), with comparison to the state of the art.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Face ReconstructionFace AlignmentFace RecognitionFace ReconstructionSimilar Papers 제목 키워드 기반
Dense Face Alignment
Face alignment is a classic problem in the computer vision field. Previous works mostly focus on sparse alignment with a limited number of facial landmark points, i.e., facial landmark detection. In this paper, for the f…
3D Face ReconstructionFace AlignmentFacial Landmark Detection“Look Ma, no landmarks!” – Unsupervised, Model-based Dense Face Alignment
no landmarks!"" - Unsupervised, model-based dense face alignment","In this paper, we show how to train an image-to-image network to predict dense correspondence between a face image and a 3D morphable model using only th…
3D Face ReconstructionCamera CalibrationFace AlignmentDense 3D Face Correspondence
We present an algorithm that automatically establishes dense correspondences between a large number of 3D faces. Starting from automatically detected sparse correspondences on the outer boundary of 3D faces, the algorith…
Face RecognitionLearning Dense Facial Correspondences in Unconstrained Images
We present a minimalistic but effective neural network that computes dense facial correspondences in highly unconstrained RGB images. Our network learns a per-pixel flow and a matchability mask between 2D input photograp…
Face AlignmentFace ModelSingle-Camera 3D Head Fitting for Mixed Reality Clinical Applications
We address the problem of estimating the shape of a person's head, defined as the geometry of the complete head surface, from a video taken with a single moving camera, and determining the alignment of the fitted 3D head…
3D ReconstructionFace ReconstructionMixed Reality