Failure Detection for Facial Landmark Detectors
Most face applications depend heavily on the accuracy of the face and facial landmarks detectors employed. Prediction of attributes such as gender, age, and identity usually completely fail when the faces are badly aligned due to inaccurate facial landmark detection. Despite the impressive recent advances in face and facial landmark detection, little study is on the recovery from and detection of failures or inaccurate predictions. In this work we study two top recent facial landmark detectors and devise confidence models for their outputs. We validate our failure detection approaches on standard benchmarks (AFLW, HELEN) and correctly identify more than 40% of the failures in the outputs of the landmark detectors. Moreover, with our failure detection we can achieve a 12% error reduction on a gender estimation application at the cost of a small increase in computation.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial Landmark DetectionSimilar Papers 제목 키워드 기반
NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments
Facial landmark localisation is a prerequisite for developing automated, non-contact neonatal pain assessment methods. Clinicians use pain scales to judge the severity of pain, many of which rely on facial expression. Ho…
Facial Landmark DetectionBenchmarking Shadow Removal for Facial Landmark Detection and Beyond
Facial landmark detection is a very fundamental and significant vision task with many important applications. In practice, facial landmark detection can be affected by a lot of natural degradations. One of the most commo…
BenchmarkingBlockingFacial Landmark DetectionShadow RemovalConvolutional Experts Constrained Local Model for Facial Landmark Detection
Constrained Local Models (CLMs) are a well-established family of methods for facial landmark detection. However, they have recently fallen out of favor to cascaded regression-based approaches. This is in part due to the …
Facial Landmark DetectionRePFormer: Refinement Pyramid Transformer for Robust Facial Landmark Detection
This paper presents a Refinement Pyramid Transformer (RePFormer) for robust facial landmark detection. Most facial landmark detectors focus on learning representative image features. However, these CNN-based feature repr…
Facial Landmark DetectionFace Detection, Bounding Box Aggregation and Pose Estimation for Robust Facial Landmark Localisation in the Wild
We present a framework for robust face detection and landmark localisation of faces in the wild, which has been evaluated as part of `the 2nd Facial Landmark Localisation Competition'. The framework has four stages: face…
Face AlignmentFace DetectionPose Estimation