Multi-spectral Facial Landmark Detection
Thermal face image analysis is favorable for certain circumstances. For example, illumination-sensitive applications, like nighttime surveillance; and privacy-preserving demanded access control. However, the inadequate study on thermal face image analysis calls for attention in responding to the industry requirements. Detecting facial landmark points are important for many face analysis tasks, such as face recognition, 3D face reconstruction, and face expression recognition. In this paper, we propose a robust neural network enabled facial landmark detection, namely Deep Multi-Spectral Learning (DMSL). Briefly, DMSL consists of two sub-models, i.e. face boundary detection, and landmark coordinates detection. Such an architecture demonstrates the capability of detecting the facial landmarks on both visible and thermal images. Particularly, the proposed DMSL model is robust in facial landmark detection where the face is partially occluded, or facing different directions. The experiment conducted on Eurecom's visible and thermal paired database shows the superior performance of DMSL over the state-of-the-art for thermal facial landmark detection. In addition to that, we have annotated a thermal face dataset with their respective facial landmark for the purpose of experimentation.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Face ReconstructionBoundary DetectionFace RecognitionFace ReconstructionFacial Landmark DetectionPrivacy PreservingSimilar Papers 제목 키워드 기반
Facial Action Unit Detection using 3D Facial Landmarks
In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical…
Action Unit DetectionFacial Action Unit DetectionArtFacePoints: High-resolution Facial Landmark Detection in Paintings and Prints
Facial landmark detection plays an important role for the similarity analysis in artworks to compare portraits of the same or similar artists. With facial landmarks, portraits of different genres, such as paintings and p…
Facial Landmark DetectionImage RegistrationStyle TransferVocal Bursts Intensity PredictionRobust Facial Landmark Detection by Cross-order Cross-semantic Deep Network
Recently, convolutional neural networks (CNNs)-based facial landmark detection methods have achieved great success. However, most of existing CNN-based facial landmark detection methods have not attempted to activate mul…
Facial Landmark DetectionFacial Landmark Detection with Tweaked Convolutional Neural Networks
We present a novel convolutional neural network (CNN) design for facial landmark coordinate regression. We examine the intermediate features of a standard CNN trained for landmark detection and show that features extract…
Face VerificationFacial Landmark DetectionregressionSimultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion
Facial landmark detection, head pose estimation, and facial deformation analysis are typical facial behavior analysis tasks in computer vision. The existing methods usually perform each task independently and sequentiall…
Facial Landmark DetectionHead Pose EstimationPose Estimation