Face Alignment using a 3D Deeply-initialized Ensemble of Regression Trees
Face alignment algorithms locate a set of landmark points in images of faces taken in unrestricted situations. State-of-the-art approaches typically fail or lose accuracy in the presence of occlusions, strong deformations, large pose variations and ambiguous configurations. In this paper we present 3DDE, a robust and efficient face alignment algorithm based on a coarse-to-fine cascade of ensembles of regression trees. It is initialized by robustly fitting a 3D face model to the probability maps produced by a convolutional neural network. With this initialization we address self-occlusions and large face rotations. Further, the regressor implicitly imposes a prior face shape on the solution, addressing occlusions and ambiguous face configurations. Its coarse-to-fine structure tackles the combinatorial explosion of parts deformation. In the experiments performed, 3DDE improves the state-of-the-art in 300W, COFW, AFLW and WFLW data sets. Finally, we perform cross-dataset experiments that reveal the existence of a significant data set bias in these benchmarks.
Code (1)
Tasks
Face AlignmentFace ModelFacial Landmark DetectionregressionSimilar Papers 제목 키워드 기반
A Deeply-initialized Coarse-to-fine Ensemble of Regression Trees for Face Alignment
In this paper we present DCFE, a real-time facial landmark regression method based on a coarse-to-fine Ensemble of Regression Trees (ERT). We use a simple Convolutional Neural Network (CNN) to generate probability maps o…
Face AlignmentFace ModelFacial Landmark DetectionregressionOne Millisecond Face Alignment with an Ensemble of Regression Trees
This paper addresses the problem of Face Alignment for a single image. We show how an ensemble of regression trees can be used to estimate the face's landmark positions directly from a sparse subset of pixel intensities,…
Data AugmentationFace Alignmentfeature selectionregressionTree-gated Deep Mixture-of-Experts For Pose-robust Face Alignment
Face alignment consists of aligning a shape model on a face image. It is an active domain in computer vision as it is a preprocessing for a number of face analysis and synthesis applications. Current state-of-the-art met…
Face AlignmentMixture-of-ExpertsregressionRobust Face AlignmentSynergy Between Face Alignment and Tracking via Discriminative Global Consensus Optimization
An open question in facial landmark localization in video is whether one should perform tracking or tracking-by-detection (i.e. face alignment). Tracking produces fittings of high accuracy but is prone to drifting. Track…
Face AlignmentOpen-Ended Question AnsweringAgreement Rate Initialized Maximum Likelihood Estimator for Ensemble Classifier Aggregation and Its Application in Brain-Computer Interface
Ensemble learning is a powerful approach to construct a strong learner from multiple base learners. The most popular way to aggregate an ensemble of classifiers is majority voting, which assigns a sample to the class tha…
Brain Computer InterfaceEnsemble LearningGeneral Classification