Subpixel Heatmap Regression for Facial Landmark Localization
Deep Learning models based on heatmap regression have revolutionized the task of facial landmark localization with existing models working robustly under large poses, non-uniform illumination and shadows, occlusions and self-occlusions, low resolution and blur. However, despite their wide adoption, heatmap regression approaches suffer from discretization-induced errors related to both the heatmap encoding and decoding process. In this work we show that these errors have a surprisingly large negative impact on facial alignment accuracy. To alleviate this problem, we propose a new approach for the heatmap encoding and decoding process by leveraging the underlying continuous distribution. To take full advantage of the newly proposed encoding-decoding mechanism, we also introduce a Siamese-based training that enforces heatmap consistency across various geometric image transformations. Our approach offers noticeable gains across multiple datasets setting a new state-of-the-art result in facial landmark localization. Code alongside the pretrained models will be made available at https://www.adrianbulat.com/face-alignment
Code (0)
등록된 구현이 없습니다.
Tasks
Face AlignmentregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Robust Face Alignment by Multi-order High-precision Hourglass Network
Heatmap regression (HR) has become one of the mainstream approaches for face alignment and has obtained promising results under constrained environments. However, when a face image suffers from large pose variations, hea…
Face AlignmentregressionRobust Face AlignmentVocal Bursts Intensity PredictionHeatmap Regression via Randomized Rounding
Heatmap regression has become the mainstream methodology for deep learning-based semantic landmark localization, including in facial landmark localization and human pose estimation. Though heatmap regression is robust to…
Face AlignmentPose EstimationQuantizationregressionAttentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking
Although heatmap regression is considered a state-of-the-art method to locate facial landmarks, it suffers from huge spatial complexity and is prone to quantization error. To address this, we propose a novel attentive on…
Face AlignmentFacial Landmark DetectionGPULandmark Tracking+2Facial Landmarks Localization using Cascaded Neural Networks
The accurate localization of facial landmarks is at the core of face analysis tasks, such as face recognition and facial expression analysis, to name a few. In this work, we propose a novel localization approach based on…
Face RecognitionFacial Landmark DetectionregressionSparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learning
Heatmap regression methods have dominated face alignment area in recent years while they ignore the inherent relation between different landmarks. In this paper, we propose a Sparse Local Patch Transformer (SLPT) for lea…
Face AlignmentRelationRobust Face Alignment