paper-with-me

Papers

Multistage Model for Robust Face Alignment Using Deep Neural Networks

2020-02-04 · Huabin Wang, Rui Cheng, Jian Zhou, Liang Tao, Hon Keung Kwan

An ability to generalize unconstrained conditions such as severe occlusions and large pose variations remains a challenging goal to achieve in face alignment. In this paper, a multistage model based on deep neural networks is proposed which takes advantage of spatial transformer networks, hourglass networks and exemplar-based shape constraints. First, a spatial transformer - generative adversarial network which consists of convolutional layers and residual units is utilized to solve the initialization issues caused by face detectors, such as rotation and scale variations, to obtain improved face bounding boxes for face alignment. Then, stacked hourglass network is employed to obtain preliminary locations of landmarks as well as their corresponding scores. In addition, an exemplar-based shape dictionary is designed to determine landmarks with low scores based on those with high scores. By incorporating face shape constraints, misaligned landmarks caused by occlusions or cluttered backgrounds can be considerably improved. Extensive experiments based on challenging benchmark datasets are performed to demonstrate the superior performance of the proposed method over other state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2002.01075

Code (0)

등록된 구현이 없습니다.

Tasks

Face AlignmentGenerative Adversarial NetworkRobust Face Alignment

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Spatial Transformer A Spatial Transformer is an image model block that explicitly allows the spatial manipulation of data within a [convolutional neural…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Hourglass Module 설명 없음

Similar Papers 제목 키워드 기반

Functional Parcellation of fMRI data using multistage k-means clustering

2022-02-19 · Harshit Parmar, Brian Nutter, Rodney Long, Sameer Antani 외

Purpose: Functional Magnetic Resonance Imaging (fMRI) data acquired through resting-state studies have been used to obtain information about the spontaneous activations inside the brain. One of the approaches for analysi…

Clustering

Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation

2019-12-26 · LREC 2020 5 · Haiyue Song, Raj Dabre, Atsushi Fujita, Sadao Kurohashi

Lectures translation is a case of spoken language translation and there is a lack of publicly available parallel corpora for this purpose. To address this, we examine a language independent framework for parallel corpus …

BenchmarkingDomain AdaptationMachine TranslationParallel Corpus Mining+2

MSACT: Multistage Spatial Alignment for Stable Low-Latency Fine Manipulation

2026-05-01 · Xianbo Cai, Hideyuki Ichiwara, Masaki Yoshikawa, Tetsuya Ogata arxiv

Real-world fine manipulation, particularly in bimanual manipulation, typically requires low-latency control and stable visual localization, while collecting large-scale data is costly and limited demonstrations may lead …

Visual LocalizationObject Tracking

MultistageOT: Multistage optimal transport infers trajectories from a snapshot of single-cell data

2025-02-07 · Magnus Tronstad, Johan Karlsson, Joakim S. Dahlin

Single-cell RNA-sequencing captures a temporal slice, or a snapshot, of a cell differentiation process. A major bioinformatical challenge is the inference of differentiation trajectories from a single snapshot, and metho…

Transformer-based Stagewise Decomposition for Large-Scale Multistage Stochastic Optimization

2024-04-03 · Chanyeong Kim, JongWoong Park, Hyunglip Bae, Woo Chang Kim

Solving large-scale multistage stochastic programming (MSP) problems poses a significant challenge as commonly used stagewise decomposition algorithms, including stochastic dual dynamic programming (SDDP), face growing t…

Stochastic Optimization