Robust Facial Landmark Localization Based on Texture and Pose Correlated Initialization
Robust facial landmark localization remains a challenging task when faces are partially occluded. Recently, the cascaded pose regression has attracted increasing attentions, due to it's superior performance in facial landmark localization and occlusion detection. However, such an approach is sensitive to initialization, where an improper initialization can severly degrade the performance. In this paper, we propose a Robust Initialization for Cascaded Pose Regression (RICPR) by providing texture and pose correlated initial shapes for the testing face. By examining the correlation of local binary patterns histograms between the testing face and the training faces, the shapes of the training faces that are most correlated with the testing face are selected as the texture correlated initialization. To make the initialization more robust to various poses, we estimate the rough pose of the testing face according to five fiducial landmarks located by multitask cascaded convolutional networks. Then the pose correlated initial shapes are constructed by the mean face's shape and the rough testing face pose. Finally, the texture correlated and the pose correlated initial shapes are joined together as the robust initialization. We evaluate RICPR on the challenging dataset of COFW. The experimental results demonstrate that the proposed scheme achieves better performances than the state-of-the-art methods in facial landmark localization and occlusion detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Face AlignmentregressionSimilar Papers 제목 키워드 기반
Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition
Meaningful facial parts can convey key cues for both facial action unit detection and expression prediction. Textured 3D face scan can provide both detailed 3D geometric shape and 2D texture appearance cues of the face w…
3D Facial Expression RecognitionAction Unit DetectionFace AlignmentFacial Action Unit Detection+2Joint Super-Resolution and Alignment of Tiny Faces
Super-resolution (SR) and landmark localization of tiny faces are highly correlated tasks. On the one hand, landmark localization could obtain higher accuracy with faces of high-resolution (HR). On the other hand, face S…
Super-ResolutionGrand Challenge of 106-Point Facial Landmark Localization
Facial landmark localization is a very crucial step in numerous face related applications, such as face recognition, facial pose estimation, face image synthesis, etc. However, previous competitions on facial landmark lo…
Face AlignmentFace RecognitionImage GenerationPose EstimationFacial Action Unit Detection via Adaptive Attention and Relation
Facial action unit (AU) detection is challenging due to the difficulty in capturing correlated information from subtle and dynamic AUs. Existing methods often resort to the localization of correlated regions of AUs, in w…
Action Unit DetectionFacial Action Unit DetectionRelationRelational ReasoningImpact of facial landmark localization on facial expression recognition
Although facial landmark localization (FLL) approaches are becoming increasingly accurate for characterizing facial regions, one question remains unanswered: what is the impact of these approaches on subsequent related t…
Face AlignmentFacial Expression RecognitionFacial Expression Recognition (FER)