paper-with-me

홈 › Papers

Face Shape-Guided Deep Feature Alignment for Face Recognition Robust to Face Misalignment

2022-09-15 · Hyung-Il Kim, Kimin Yun, Yong Man Ro

For the past decades, face recognition (FR) has been actively studied in computer vision and pattern recognition society. Recently, due to the advances in deep learning, the FR technology shows high performance for most of the benchmark datasets. However, when the FR algorithm is applied to a real-world scenario, the performance has been known to be still unsatisfactory. This is mainly attributed to the mismatch between training and testing sets. Among such mismatches, face misalignment between training and testing faces is one of the factors that hinder successful FR. To address this limitation, we propose a face shape-guided deep feature alignment framework for FR robust to the face misalignment. Based on a face shape prior (e.g., face keypoints), we train the proposed deep network by introducing alignment processes, i.e., pixel and feature alignments, between well-aligned and misaligned face images. Through the pixel alignment process that decodes the aggregated feature extracted from a face image and face shape prior, we add the auxiliary task to reconstruct the well-aligned face image. Since the aggregated features are linked to the face feature extraction network as a guide via the feature alignment process, we train the robust face feature to the face misalignment. Even if the face shape estimation is required in the training stage, the additional face alignment process, which is usually incorporated in the conventional FR pipeline, is not necessarily needed in the testing phase. Through the comparative experiments, we validate the effectiveness of the proposed method for the face misalignment with the FR datasets.

📄 PDF Abstract BibTeX arXiv:2209.07220

Code (0)

등록된 구현이 없습니다.

Tasks

Face AlignmentFace Recognition

Similar Papers 제목 키워드 기반

FlowFace: Semantic Flow-guided Shape-aware Face Swapping

2022-12-06 · Hao Zeng, Wei zhang, Changjie Fan, Tangjie Lv 외

In this work, we propose a semantic flow-guided two-stage framework for shape-aware face swapping, namely FlowFace. Unlike most previous methods that focus on transferring the source inner facial features but neglect fac…

Face Swapping

Face Alignment Using K-Cluster Regression Forests With Weighted Splitting

2017-06-06 · Marek Kowalski, Jacek Naruniec

In this work we present a face alignment pipeline based on two novel methods: weighted splitting for K-cluster Regression Forests and 3D Affine Pose Regression for face shape initialization. Our face alignment method is …

Face Alignmentregression

Reference-guided Face Component Editing

2020-06-03 · Qiyao Deng, Jie Cao, Yunfan Liu, Zhenhua Chai 외

Face portrait editing has achieved great progress in recent years. However, previous methods either 1) operate on pre-defined face attributes, lacking the flexibility of controlling shapes of high-level semantic facial c…

Image Inpainting

Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images

2023-08-31 · ICCV 2023 1 · Cuican Yu, Guansong Lu, Yihan Zeng, Jian Sun 외

Generating 3D faces from textual descriptions has a multitude of applications, such as gaming, movie, and robotics. Recent progresses have demonstrated the success of unconditional 3D face generation and text-to-3D shape…

3D Shape GenerationContrastive Learningcross-modal alignmentFace Generation+2

Recursive Spatial Transformer (ReST) for Alignment-Free Face Recognition

2017-10-01 · ICCV 2017 10 · Wanglong Wu, Meina Kan, Xin Liu, Yi Yang 외

Convolutional Neural Network (CNN) has led to significant progress in face recognition. Currently most CNN-based face recognition methods follow a two-step pipeline, i.e. a detected face is first aligned to a canonical o…

Face AlignmentFace Recognition