paper-with-me

홈 › Papers

A Deep Regression Architecture With Two-Stage Re-Initialization for High Performance Facial Landmark Detection

2017-07-01 · CVPR 2017 7 · Jiangjing Lv, Xiaohu Shao, Junliang Xing, Cheng Cheng, Xi Zhou

Regression based facial landmark detection methods usually learns a series of regression functions to update the landmark positions from an initial estimation. Most of existing approaches focus on learning effective mapping functions with robust image features to improve performance. The approach to dealing with the initialization issue, however, receives relatively fewer attentions. In this paper, we present a deep regression architecture with two-stage re-initialization to explicitly deal with the initialization problem. At the global stage, given an image with a rough face detection result, the full face region is firstly re-initialized by a supervised spatial transformer network to a canonical shape state and then trained to regress a coarse landmark estimation. At the local stage, different face parts are further separately re-initialized to their own canonical shape states, followed by another regression subnetwork to get the final estimation. Our proposed deep architecture is trained from end to end and obtains promising results using different kinds of unstable initialization. It also achieves superior performances over many competing algorithms.

📄 PDF Abstract BibTeX

Code (1)

shaoxiaohu/Face_Alignment_Two_Stage_Re-initialization

Tasks

Face DetectionFacial Landmark Detectionregression

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Spatial Transformer A Spatial Transformer is an image model block that explicitly allows the spatial manipulation of data within a [convolutional neural…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

GBT: Two-stage transformer framework for non-stationary time series forecasting

2023-07-17 · Li Shen, Yuning Wei, Yangzhu Wang

This paper shows that time series forecasting Transformer (TSFT) suffers from severe over-fitting problem caused by improper initialization method of unknown decoder inputs, esp. when handling non-stationary time series.…

DecoderregressionTime SeriesTime Series Forecasting

Neural network initialization with nonlinear characteristics and information on hierarchical features

2025-11-04 · Hikaru Homma, Jun Ohkubo arxiv

Initialization of neural network parameters, such as weights and biases, has a crucial impact on learning performance; if chosen well, we can even avoid the need for additional training with backpropagation. For example,…

On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory

2024-10-08 · Guhan Chen, Yicheng Li, Qian Lin

This paper aims to discuss the impact of random initialization of neural networks in the neural tangent kernel (NTK) theory, which is ignored by most recent works in the NTK theory. It is well known that as the network's…

CoopInit: Initializing Generative Adversarial Networks via Cooperative Learning

2023-03-21 · Yang Zhao, Jianwen Xie, Ping Li

Numerous research efforts have been made to stabilize the training of the Generative Adversarial Networks (GANs), such as through regularization and architecture design. However, we identify the instability can also aris…

Image GenerationImage-to-Image Translation

Evaluation of Population Initialization Methods for Genetic Programming-based Symbolic Regression

2026-06-30 · Lukas Kammerer, Gabriel Kronberger, Deaglan J. Bartlett, Harry Desmond 외 arxiv

We analyze the effect of optimizing the initial population of genetic programming (GP) for symbolic regression (SR) on the accuracy and complexity of solutions. We compare three well-established random initialization met…