paper-with-me

Papers

Sub-pixel face landmarks using heatmaps and a bag of tricks

2021-03-04 · Samuel W. F. Earp, Aubin Samacoits, Sanjana Jain, Pavit Noinongyao, Siwa Boonpunmongkol

Accurate face landmark localization is an essential part of face recognition, reconstruction and morphing. To accurately localize face landmarks, we present our heatmap regression approach. Each model consists of a MobileNetV2 backbone followed by several upscaling layers, with different tricks to optimize both performance and inference cost. We use five na\"ive face landmarks from a publicly available face detector to position and align the face instead of using the bounding box like traditional methods. Moreover, we show by adding random rotation, displacement and scaling -- after alignment -- that the model is more sensitive to the face position than orientation. We also show that it is possible to reduce the upscaling complexity by using a mixture of deconvolution and pixel-shuffle layers without impeding localization performance. We present our state-of-the-art face landmark localization model (ranking second on The 2nd Grand Challenge of 106-Point Facial Landmark Localization validation set). Finally, we test the effect on face recognition using these landmarks, using a publicly available model and benchmarks.

📄 PDF Abstract BibTeX arXiv:2103.03059

Code (0)

등록된 구현이 없습니다.

Tasks

Face AlignmentFace RecognitionPosition

Methods 이 논문이 사용한 방법론

Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Batch Normalization 설명 없음
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
Heatmap 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

Unsupervised Landmark Discovery Using Consistency Guided Bottleneck

2023-09-19 · Mamona Awan, Muhammad Haris Khan, Sanoojan Baliah, Muhammad Ahmad Waseem 외

We study a challenging problem of unsupervised discovery of object landmarks. Many recent methods rely on bottlenecks to generate 2D Gaussian heatmaps however, these are limited in generating informed heatmaps while trai…

Image Reconstruction

Two-stage Convolutional Part Heatmap Regression for the 1st 3D Face Alignment in the Wild (3DFAW) Challenge

2016-09-29 · Adrian Bulat, Georgios Tzimiropoulos

This paper describes our submission to the 1st 3D Face Alignment in the Wild (3DFAW) Challenge. Our method builds upon the idea of convolutional part heatmap regression [1], extending it for 3D face alignment. Our method…

3D Face AlignmentDepth EstimationFace Alignmentregression

Joint Action Unit localisation and intensity estimation through heatmap regression

2018-05-09 · Enrique Sanchez-Lozano, Georgios Tzimiropoulos, Michel Valstar

This paper proposes a supervised learning approach to jointly perform facial Action Unit (AU) localisation and intensity estimation. Contrary to previous works that try to learn an unsupervised representation of the Acti…

regression

A survey and classification of face alignment methods based on face models

2023-11-06 · Jagmohan Meher, Hector Allende-Cid, Torbjörn E. M. Nordling

A face model is a mathematical representation of the distinct features of a human face. Traditionally, face models were built using a set of fiducial points or landmarks, each point ideally located on a facial feature, i…

Face AlignmentFace Model

Learning landmark guided embeddings for animal re-identification

2020-01-09 · Olga Moskvyak, Frederic Maire, Feras Dayoub, Mahsa Baktashmotlagh

Re-identification of individual animals in images can be ambiguous due to subtle variations in body markings between different individuals and no constraints on the poses of animals in the wild. Person re-identification …

Person Re-Identification