Fast Landmark Localization with 3D Component Reconstruction and CNN for Cross-Pose Recognition
Two approaches are proposed for cross-pose face recognition, one is based on the 3D reconstruction of facial components and the other is based on the deep Convolutional Neural Network (CNN). Unlike most 3D approaches that consider holistic faces, the proposed approach considers 3D facial components. It segments a 2D gallery face into components, reconstructs the 3D surface for each component, and recognizes a probe face by component features. The segmentation is based on the landmarks located by a hierarchical algorithm that combines the Faster R-CNN for face detection and the Reduced Tree Structured Model for landmark localization. The core part of the CNN-based approach is a revised VGG network. We study the performances with different settings on the training set, including the synthesized data from 3D reconstruction, the real-life data from an in-the-wild database, and both types of data combined. We investigate the performances of the network when it is employed as a classifier or designed as a feature extractor. The two recognition approaches and the fast landmark localization are evaluated in extensive experiments, and compared to stateof-the-art methods to demonstrate their efficacy.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionFace DetectionFace RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Regressive Tree Structured Model for Facial Landmark Localization
Although the Tree Structured Model (TSM) is proven effective for solving face detection, pose estimation and landmark localization in an unified model, its sluggish run time makes it unfavorable in practical applications…
Face AlignmentFace DetectionmodelPose EstimationImproved Scene Landmark Detection for Camera Localization
Camera localization methods based on retrieval, local feature matching, and 3D structure-based pose estimation are accurate but require high storage, are slow, and are not privacy-preserving. A method based on scene land…
Camera LocalizationPose EstimationPrivacy PreservingFaceLift: Semi-supervised 3D Facial Landmark Localization
3D facial landmark localization has proven to be of particular use for applications, such as face tracking, 3D face modeling, and image-based 3D face reconstruction. In the supervised learning case, such methods usually …
3D Face Reconstruction3D Facial Landmark LocalizationFace AlignmentFace ReconstructionGrand Challenge of 106-Point Facial Landmark Localization
Facial landmark localization is a very crucial step in numerous face related applications, such as face recognition, facial pose estimation, face image synthesis, etc. However, previous competitions on facial landmark lo…
Face AlignmentFace RecognitionImage GenerationPose EstimationIntegrating Spatial Configuration into Heatmap Regression Based CNNs for Landmark Localization
In many medical image analysis applications, often only a limited amount of training data is available, which makes training of convolutional neural networks (CNNs) challenging. In this work on anatomical landmark locali…
Medical Image Analysisregression