paper-with-me

홈 › Papers

A Recurrent Encoder-Decoder Network for Sequential Face Alignment

2016-08-19 · Xi Peng, Rogerio S. Feris, Xiaoyu Wang, Dimitris N. Metaxas

We propose a novel recurrent encoder-decoder network model for real-time video-based face alignment. Our proposed model predicts 2D facial point maps regularized by a regression loss, while uniquely exploiting recurrent learning at both spatial and temporal dimensions. At the spatial level, we add a feedback loop connection between the combined output response map and the input, in order to enable iterative coarse-to-fine face alignment using a single network model. At the temporal level, we first decouple the features in the bottleneck of the network into temporal-variant factors, such as pose and expression, and temporal-invariant factors, such as identity information. Temporal recurrent learning is then applied to the decoupled temporal-variant features, yielding better generalization and significantly more accurate results at test time. We perform a comprehensive experimental analysis, showing the importance of each component of our proposed model, as well as superior results over the state-of-the-art in standard datasets.

📄 PDF Abstract BibTeX arXiv:1608.05477

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderFace Alignment

Similar Papers 제목 키워드 기반

RED-Net: A Recurrent Encoder-Decoder Network for Video-based Face Alignment

2018-01-17 · Xi Peng, Rogerio S. Feris, Xiaoyu Wang, Dimitris N. Metaxas

We propose a novel method for real-time face alignment in videos based on a recurrent encoder-decoder network model. Our proposed model predicts 2D facial point heat maps regularized by both detection and regression loss…

DecoderFace Alignment

Context- and Sequence-Aware Convolutional Recurrent Encoder for Neural Machine Translation

2021-01-11 · Ritam Mallick, Seba Susan, Vaibhaw Agrawal, Rizul Garg 외

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the…

DecoderMachine TranslationSentenceTranslation

Automated Audio Captioning with Recurrent Neural Networks

2017-06-30 · Konstantinos Drossos, Sharath Adavanne, Tuomas Virtanen

We present the first approach to automated audio captioning. We employ an encoder-decoder scheme with an alignment model in between. The input to the encoder is a sequence of log mel-band energies calculated from an audi…

Audio captioningDecoderGeneral ClassificationImage Captioning+2

Recurrent Auto-Encoder Model for Multidimensional Time Series Representation

2018-01-01 · ICLR 2018 1 · Timothy Wong, Zhiyuan Luo

Recurrent auto-encoder model can summarise sequential data through an encoder structure into a fixed-length vector and then reconstruct into its original sequential form through the decoder structure. The summarised info…

ClusteringDecoderTime SeriesTime Series Analysis

Understanding attention-based encoder-decoder networks: a case study with chess scoresheet recognition

2024-04-23 · Sergio Y. Hayashi, Nina S. T. Hirata

Deep neural networks are largely used for complex prediction tasks. There is plenty of empirical evidence of their successful end-to-end training for a diversity of tasks. Success is often measured based solely on the fi…

DecoderDiversityHandwriting Recognition