Convolutional Experts Constrained Local Model for Facial Landmark Detection
Constrained Local Models (CLMs) are a well-established family of methods for facial landmark detection. However, they have recently fallen out of favor to cascaded regression-based approaches. This is in part due to the inability of existing CLM local detectors to model the very complex individual landmark appearance that is affected by expression, illumination, facial hair, makeup, and accessories. In our work, we present a novel local detector -- Convolutional Experts Network (CEN) -- that brings together the advantages of neural architectures and mixtures of experts in an end-to-end framework. We further propose a Convolutional Experts Constrained Local Model (CE-CLM) algorithm that uses CEN as local detectors. We demonstrate that our proposed CE-CLM algorithm outperforms competitive state-of-the-art baselines for facial landmark detection by a large margin on four publicly-available datasets. Our approach is especially accurate and robust on challenging profile images.
Code (1)
Tasks
Facial Landmark DetectionSimilar Papers 제목 키워드 기반
Facial Landmark Machines: A Backbone-Branches Architecture with Progressive Representation Learning
Facial landmark localization plays a critical role in face recognition and analysis. In this paper, we propose a novel cascaded backbone-branches fully convolutional neural network~(BB-FCN) for rapidly and accurately loc…
Face AlignmentFace DetectionFace RecognitionRepresentation LearningUnconstrained Facial Landmark Localization with Backbone-Branches Fully-Convolutional Networks
This paper investigates how to rapidly and accurately localize facial landmarks in unconstrained, cluttered environments rather than in the well segmented face images. We present a novel Backbone-Branches Fully-Convoluti…
Face AlignmentConstrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection
Cascade regression framework has been shown to be effective for facial landmark detection. It starts from an initial face shape and gradually predicts the face shape update from the local appearance features to generate …
Facial Action Unit DetectionFacial Landmark DetectionregressionRobust Facial Landmark Detection via a Fully-Convolutional Local-Global Context Network
While fully-convolutional neural networks are very strong at modeling local features, they fail to aggregate global context due to their constrained receptive field. Modern methods typically address the lack of global co…
Facial Landmark DetectionConvolutional aggregation of local evidence for large pose face alignment
Methods for unconstrained face alignment must satisfy two requirements: they must not rely on accurate initialisation/face detection and they should perform equally well for the whole spectrum of facial poses. To the bes…
Face AlignmentFace Detectionregression