Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

2017-09-23 · CVPR 2017 7 · Yue Wu, Chao Gou, Qiang Ji

Facial landmark detection, head pose estimation, and facial deformation analysis are typical facial behavior analysis tasks in computer vision. The existing methods usually perform each task independently and sequentially, ignoring their interactions. To tackle this problem, we propose a unified framework for simultaneous facial landmark detection, head pose estimation, and facial deformation analysis, and the proposed model is robust to facial occlusion. Following a cascade procedure augmented with model-based head pose estimation, we iteratively update the facial landmark locations, facial occlusion, head pose and facial de- formation until convergence. The experimental results on benchmark databases demonstrate the effectiveness of the proposed method for simultaneous facial landmark detection, head pose and facial deformation estimation, even if the images are under facial occlusion.

📄 PDF Abstract BibTeX arXiv:1709.08130

Code (0)

등록된 구현이 없습니다.

Tasks

Facial Landmark Detection Head Pose Estimation Pose Estimation

Facial Image Deformation Based on Landmark Detection

2019-10-30 · Chaoyue Song, Yugang Chen, Shulai Zhang, Bingbing Ni

In this work, we use facial landmarks to make the deformation for facial images more authentic. The deformation includes the expansion of eyes and the shrinking of noses, mouths, and cheeks. An advanced 106-point facial …

LDDMM-Face: Large Deformation Diffeomorphic Metric Learning for Cross-annotation Face Alignment

2021-09-29 · Huilin Yang, Junyan Lyu, Pujin Cheng, Roger Tam 외

We innovatively propose a flexible and consistent cross-annotation face alignment framework, LDDMM-Face, the key contribution of which is a deformation layer that naturally embeds facial geometry in a diffeomorphic way. …

Face Alignment Metric Learning

LDDMM-Face: Large Deformation Diffeomorphic Metric Learning for Flexible and Consistent Face Alignment

2021-08-02 · Huilin Yang, Junyan Lyu, Pujin Cheng, Xiaoying Tang

We innovatively propose a flexible and consistent face alignment framework, LDDMM-Face, the key contribution of which is a deformation layer that naturally embeds facial geometry in a diffeomorphic way. Instead of predic…

Face Alignment Metric Learning Weakly-supervised Learning

Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection

2017-09-23 · CVPR 2016 6 · Yue Wu, Qiang Ji

Cascade regression framework has been shown to be effective for facial landmark detection. It starts from an initial face shape and gradually predicts the face shape update from the local appearance features to generate …

Facial Action Unit Detection Facial Landmark Detection regression

Facial Landmark Detection: a Literature Survey

2018-05-15 · Yue Wu, Qiang Ji

The locations of the fiducial facial landmark points around facial components and facial contour capture the rigid and non-rigid facial deformations due to head movements and facial expressions. They are hence important …

Facial Landmark Detection regression Survey