Facial Landmark Machines: A Backbone-Branches Architecture with Progressive Representation Learning
Facial landmark localization plays a critical role in face recognition and analysis. In this paper, we propose a novel cascaded backbone-branches fully convolutional neural network~(BB-FCN) for rapidly and accurately localizing facial landmarks in unconstrained and cluttered settings. Our proposed BB-FCN generates facial landmark response maps directly from raw images without any preprocessing. BB-FCN follows a coarse-to-fine cascaded pipeline, which consists of a backbone network for roughly detecting the locations of all facial landmarks and one branch network for each type of detected landmark for further refining their locations. Furthermore, to facilitate the facial landmark localization under unconstrained settings, we propose a large-scale benchmark named SYSU16K, which contains 16000 faces with large variations in pose, expression, illumination and resolution. Extensive experimental evaluations demonstrate that our proposed BB-FCN can significantly outperform the state-of-the-art under both constrained (i.e., within detected facial regions only) and unconstrained settings. We further confirm that high-quality facial landmarks localized with our proposed network can also improve the precision and recall of face detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Face AlignmentFace DetectionFace RecognitionRepresentation LearningSimilar Papers 제목 키워드 기반
Unconstrained Facial Landmark Localization with Backbone-Branches Fully-Convolutional Networks
This paper investigates how to rapidly and accurately localize facial landmarks in unconstrained, cluttered environments rather than in the well segmented face images. We present a novel Backbone-Branches Fully-Convoluti…
Face AlignmentPrivileged Attribution Constrained Deep Networks for Facial Expression Recognition
Facial Expression Recognition (FER) is crucial in many research domains because it enables machines to better understand human behaviours. FER methods face the problems of relatively small datasets and noisy data that do…
Facial Expression RecognitionFacial Expression Recognition (FER)LocalEyenet: Deep Attention framework for Localization of Eyes
Development of human machine interface has become a necessity for modern day machines to catalyze more autonomy and more efficiency. Gaze driven human intervention is an effective and convenient option for creating an in…
Deep AttentionFacial Landmark DetectionSimFLE: Simple Facial Landmark Encoding for Self-Supervised Facial Expression Recognition in the Wild
One of the key issues in facial expression recognition in the wild (FER-W) is that curating large-scale labeled facial images is challenging due to the inherent complexity and ambiguity of facial images. Therefore, in th…
Face AlignmentFacial Expression RecognitionFacial Expression Recognition (FER)Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines
Facial expressions are widely used in the behavioral interpretation of emotions, cognitive science, and social interactions. In this paper, we present a novel method for fully automatic facial expression recognition in f…
Dynamic Time WarpingFacial Expression RecognitionFacial Expression Recognition (FER)Graph Matching+1