MaskFace: multi-task face and landmark detector

2020-05-19 · Dmitry Yashunin, Tamir Baydasov, Roman Vlasov

Currently in the domain of facial analysis single task approaches for face detection and landmark localization dominate. In this paper we draw attention to multi-task models solving both tasks simultaneously. We present a highly accurate model for face and landmark detection. The method, called MaskFace, extends previous face detection approaches by adding a keypoint prediction head. The new keypoint head adopts ideas of Mask R-CNN by extracting facial features with a RoIAlign layer. The keypoint head adds small computational overhead in the case of few faces in the image while improving the accuracy dramatically. We evaluate MaskFace's performance on a face detection task on the AFW, PASCAL face, FDDB, WIDER FACE datasets and a landmark localization task on the AFLW, 300W datasets. For both tasks MaskFace achieves state-of-the-art results outperforming many of single-task and multi-task models.

📄 PDF Abstract BibTeX arXiv:2005.09412

Code (0)

등록된 구현이 없습니다.

Tasks

Face Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Infinite 3D Landmarks: Improving Continuous 2D Facial Landmark Detection

2024-05-30 · Prashanth Chandran, Gaspard Zoss, Paulo Gotardo, Derek Bradley

In this paper, we examine 3 important issues in the practical use of state-of-the-art facial landmark detectors and show how a combination of specific architectural modifications can directly improve their accuracy and t…

Facial Landmark Detection

High Resolution Face Editing with Masked GAN Latent Code Optimization

2021-03-20 · Martin Pernuš, Vitomir Štruc, Simon Dobrišek

Face editing represents a popular research topic within the computer vision and image processing communities. While significant progress has been made recently in this area, existing solutions: (i) are still largely focu…

Attribute Face Parsing Generative Adversarial Network Vocal Bursts Intensity Prediction

FacePoseNet: Making a Case for Landmark-Free Face Alignment

2017-08-24 · Feng-Ju Chang, Anh Tuan Tran, Tal Hassner, Iacopo Masi 외

We show how a simple convolutional neural network (CNN) can be trained to accurately and robustly regress 6 degrees of freedom (6DoF) 3D head pose, directly from image intensities. We further explain how this FacePoseNet…

3D Face Alignment Face Alignment Face Identification Face Recognition+2

Failure Detection for Facial Landmark Detectors

2016-08-23 · Andreas Steger, Radu Timofte, Luc van Gool

Most face applications depend heavily on the accuracy of the face and facial landmarks detectors employed. Prediction of attributes such as gender, age, and identity usually completely fail when the faces are badly align…

Facial Landmark Detection

Joint Multi-view Face Alignment in the Wild

2017-08-20 · Jiankang Deng, George Trigeorgis, Yuxiang Zhou, Stefanos Zafeiriou

The de facto algorithm for facial landmark estimation involves running a face detector with a subsequent deformable model fitting on the bounding box. This encompasses two basic problems: i) the detection and deformable …

Face Alignment Face Detection