Learning Expressionlets via Universal Manifold Model for Dynamic Facial Expression Recognition
Facial expression is temporally dynamic event which can be decomposed into a set of muscle motions occurring in different facial regions over various time intervals. For dynamic expression recognition, two key issues, temporal alignment and semantics-aware dynamic representation, must be taken into account. In this paper, we attempt to solve both problems via manifold modeling of videos based on a novel mid-level representation, i.e. \textbf{expressionlet}. Specifically, our method contains three key stages: 1) each expression video clip is characterized as a spatial-temporal manifold (STM) formed by dense low-level features; 2) a Universal Manifold Model (UMM) is learned over all low-level features and represented as a set of local modes to statistically unify all the STMs. 3) the local modes on each STM can be instantiated by fitting to UMM, and the corresponding expressionlet is constructed by modeling the variations in each local mode. With above strategy, expression videos are naturally aligned both spatially and temporally. To enhance the discriminative power, the expressionlet-based STM representation is further processed with discriminant embedding. Our method is evaluated on four public expression databases, CK+, MMI, Oulu-CASIA, and FERA. In all cases, our method outperforms the known state-of-the-art by a large margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Dynamic Facial Expression RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)Similar Papers 제목 키워드 기반
Learning Expressionlets on Spatio-Temporal Manifold for Dynamic Facial Expression Recognition
Facial expression is temporally dynamic event which can be decomposed into a set of muscle motions occurring in different facial regions over various time intervals. For dynamic expression recognition, two key issues, te…
Dynamic Facial Expression RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)Dynamic Facial Expression Generation on Hilbert Hypersphere with Conditional Wasserstein Generative Adversarial Nets
In this work, we propose a novel approach for generating videos of the six basic facial expressions given a neutral face image. We propose to exploit the face geometry by modeling the facial landmarks motion as curves en…
Data AugmentationEmotion RecognitionFacial expression generationGenerative Adversarial Network+1Automatic Analysis of Facial Expressions Based on Deep Covariance Trajectories
In this paper, we propose a new approach for facial expression recognition using deep covariance descriptors. The solution is based on the idea of encoding local and global Deep Convolutional Neural Network (DCNN) featur…
ClassificationFacial Expression RecognitionFacial Expression Recognition (FER)General Classification+1Geometry-Contrastive GAN for Facial Expression Transfer
In this paper, we propose a Geometry-Contrastive Generative Adversarial Network (GC-GAN) for transferring continuous emotions across different subjects. Given an input face with certain emotion and a target facial expres…
Contrastive LearningGenerative Adversarial NetworkSoft Locality Preserving Map (SLPM) for Facial Expression Recognition
For image recognition, an extensive number of methods have been proposed to overcome the high-dimensionality problem of feature vectors being used. These methods vary from unsupervised to supervised, and from statistics …
Dimensionality ReductionFacial Expression RecognitionFacial Expression Recognition (FER)