Multistage Model for Robust Face Alignment Using Deep Neural Networks
An ability to generalize unconstrained conditions such as severe occlusions and large pose variations remains a challenging goal to achieve in face alignment. In this paper, a multistage model based on deep neural networks is proposed which takes advantage of spatial transformer networks, hourglass networks and exemplar-based shape constraints. First, a spatial transformer - generative adversarial network which consists of convolutional layers and residual units is utilized to solve the initialization issues caused by face detectors, such as rotation and scale variations, to obtain improved face bounding boxes for face alignment. Then, stacked hourglass network is employed to obtain preliminary locations of landmarks as well as their corresponding scores. In addition, an exemplar-based shape dictionary is designed to determine landmarks with low scores based on those with high scores. By incorporating face shape constraints, misaligned landmarks caused by occlusions or cluttered backgrounds can be considerably improved. Extensive experiments based on challenging benchmark datasets are performed to demonstrate the superior performance of the proposed method over other state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Face AlignmentGenerative Adversarial NetworkRobust Face AlignmentMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Functional Parcellation of fMRI data using multistage k-means clustering
Purpose: Functional Magnetic Resonance Imaging (fMRI) data acquired through resting-state studies have been used to obtain information about the spontaneous activations inside the brain. One of the approaches for analysi…
ClusteringCoursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation
Lectures translation is a case of spoken language translation and there is a lack of publicly available parallel corpora for this purpose. To address this, we examine a language independent framework for parallel corpus …
BenchmarkingDomain AdaptationMachine TranslationParallel Corpus Mining+2MSACT: Multistage Spatial Alignment for Stable Low-Latency Fine Manipulation
Real-world fine manipulation, particularly in bimanual manipulation, typically requires low-latency control and stable visual localization, while collecting large-scale data is costly and limited demonstrations may lead …
Visual LocalizationObject TrackingMultistageOT: Multistage optimal transport infers trajectories from a snapshot of single-cell data
Single-cell RNA-sequencing captures a temporal slice, or a snapshot, of a cell differentiation process. A major bioinformatical challenge is the inference of differentiation trajectories from a single snapshot, and metho…
Transformer-based Stagewise Decomposition for Large-Scale Multistage Stochastic Optimization
Solving large-scale multistage stochastic programming (MSP) problems poses a significant challenge as commonly used stagewise decomposition algorithms, including stochastic dual dynamic programming (SDDP), face growing t…
Stochastic Optimization