Robust Facial Landmark Detection by Cross-order Cross-semantic Deep Network
Recently, convolutional neural networks (CNNs)-based facial landmark detection methods have achieved great success. However, most of existing CNN-based facial landmark detection methods have not attempted to activate multiple correlated facial parts and learn different semantic features from them that they can not accurately model the relationships among the local details and can not fully explore more discriminative and fine semantic features, thus they suffer from partial occlusions and large pose variations. To address these problems, we propose a cross-order cross-semantic deep network (CCDN) to boost the semantic features learning for robust facial landmark detection. Specifically, a cross-order two-squeeze multi-excitation (CTM) module is proposed to introduce the cross-order channel correlations for more discriminative representations learning and multiple attention-specific part activation. Moreover, a novel cross-order cross-semantic (COCS) regularizer is designed to drive the network to learn cross-order cross-semantic features from different activation for facial landmark detection. It is interesting to show that by integrating the CTM module and COCS regularizer, the proposed CCDN can effectively activate and learn more fine and complementary cross-order cross-semantic features to improve the accuracy of facial landmark detection under extremely challenging scenarios. Experimental results on challenging benchmark datasets demonstrate the superiority of our CCDN over state-of-the-art facial landmark detection methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial Landmark DetectionSimilar Papers 제목 키워드 기반
Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks
Recently, heatmap regression has been widely explored in facial landmark detection and obtained remarkable performance. However, most of the existing heatmap regression-based facial landmark detection methods neglect to …
Facial Landmark DetectionregressionRePFormer: Refinement Pyramid Transformer for Robust Facial Landmark Detection
This paper presents a Refinement Pyramid Transformer (RePFormer) for robust facial landmark detection. Most facial landmark detectors focus on learning representative image features. However, these CNN-based feature repr…
Facial Landmark DetectionTowards Accurate Facial Landmark Detection via Cascaded Transformers
Accurate facial landmarks are essential prerequisites for many tasks related to human faces. In this paper, an accurate facial landmark detector is proposed based on cascaded transformers. We formulate facial landmark de…
DecoderFace AlignmentFacial Landmark DetectionImproving Facial Landmark Detection Accuracy and Efficiency with Knowledge Distillation
The domain of computer vision has experienced significant advancements in facial-landmark detection, becoming increasingly essential across various applications such as augmented reality, facial recognition, and emotion …
Emotion RecognitionFacial Landmark DetectionKnowledge Distillationobject-detection+2A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose
Extreme head postures pose a common challenge across a spectrum of facial analysis tasks, including face detection, facial landmark detection (FLD), and head pose estimation (HPE). These tasks are interdependent, where a…
Face DetectionFacial Landmark DetectionHead Pose EstimationMulti-Task Learning+2