A Recurrent Encoder-Decoder Network for Sequential Face Alignment
We propose a novel recurrent encoder-decoder network model for real-time video-based face alignment. Our proposed model predicts 2D facial point maps regularized by a regression loss, while uniquely exploiting recurrent learning at both spatial and temporal dimensions. At the spatial level, we add a feedback loop connection between the combined output response map and the input, in order to enable iterative coarse-to-fine face alignment using a single network model. At the temporal level, we first decouple the features in the bottleneck of the network into temporal-variant factors, such as pose and expression, and temporal-invariant factors, such as identity information. Temporal recurrent learning is then applied to the decoupled temporal-variant features, yielding better generalization and significantly more accurate results at test time. We perform a comprehensive experimental analysis, showing the importance of each component of our proposed model, as well as superior results over the state-of-the-art in standard datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderFace AlignmentSimilar Papers 제목 키워드 기반
RED-Net: A Recurrent Encoder-Decoder Network for Video-based Face Alignment
We propose a novel method for real-time face alignment in videos based on a recurrent encoder-decoder network model. Our proposed model predicts 2D facial point heat maps regularized by both detection and regression loss…
DecoderFace AlignmentContext- and Sequence-Aware Convolutional Recurrent Encoder for Neural Machine Translation
Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the…
DecoderMachine TranslationSentenceTranslationAutomated Audio Captioning with Recurrent Neural Networks
We present the first approach to automated audio captioning. We employ an encoder-decoder scheme with an alignment model in between. The input to the encoder is a sequence of log mel-band energies calculated from an audi…
Audio captioningDecoderGeneral ClassificationImage Captioning+2Recurrent Auto-Encoder Model for Multidimensional Time Series Representation
Recurrent auto-encoder model can summarise sequential data through an encoder structure into a fixed-length vector and then reconstruct into its original sequential form through the decoder structure. The summarised info…
ClusteringDecoderTime SeriesTime Series AnalysisUnderstanding attention-based encoder-decoder networks: a case study with chess scoresheet recognition
Deep neural networks are largely used for complex prediction tasks. There is plenty of empirical evidence of their successful end-to-end training for a diversity of tasks. Success is often measured based solely on the fi…
DecoderDiversityHandwriting Recognition