From Macro to Micro: Boosting micro-expression recognition via pre-training on macro-expression videos
Micro-expression recognition (MER) has drawn increasing attention in recent years due to its potential applications in intelligent medical and lie detection. However, the shortage of annotated data has been the major obstacle to further improve deep-learning based MER methods. Intuitively, utilizing sufficient macro-expression data to promote MER performance seems to be a feasible solution. However, the facial patterns of macro-expressions and micro-expressions are significantly different, which makes naive transfer learning methods difficult to deploy directly. To tacle this issue, we propose a generalized transfer learning paradigm, called \textbf{MA}cro-expression \textbf{TO} \textbf{MI}cro-expression (MA2MI). Under our paradigm, networks can learns the ability to represent subtle facial movement by reconstructing future frames. In addition, we also propose a two-branch micro-action network (MIACNet) to decouple facial position features and facial action features, which can help the network more accurately locate facial action locations. Extensive experiments on three popular MER benchmarks demonstrate the superiority of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Micro Expression RecognitionMicro-Expression RecognitionTransfer LearningSimilar Papers 제목 키워드 기반
SAMM Long Videos: A Spontaneous Facial Micro- and Macro-Expressions Dataset
With the growth of popularity of facial micro-expressions in recent years, the demand for long videos with micro- and macro-expressions remains high. Extended from SAMM, a micro-expressions dataset released in 2016, this…
Face AlignmentEfficient Neural Architecture Search for Emotion Recognition
Automated human emotion recognition from facial expressions is a well-studied problem and still remains a very challenging task. Some efficient or accurate deep learning models have been presented in the literature. Howe…
Emotion RecognitionFacial Expression RecognitionMicro Expression RecognitionMicro-Expression Recognition+1Advanced local motion patterns for macro and micro facial expression recognition
In this paper, we develop a new method that recognizes facial expressions, on the basis of an innovative local motion patterns feature, with three main contributions. The first one is the analysis of the face skin tempor…
Facial Expression RecognitionFacial Expression Recognition (FER)Micro Expression RecognitionMicro-Expression RecognitionAn Overview of Facial Micro-Expression Analysis: Data, Methodology and Challenge
Facial micro-expressions indicate brief and subtle facial movements that appear during emotional communication. In comparison to macro-expressions, micro-expressions are more challenging to be analyzed due to the short s…
DiversityMicro Expression RecognitionMicro-Expression RecognitionMicro-Expression Spotting+1Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms
Unlike the conventional facial expressions, micro-expressions are involuntary and transient facial expressions capable of revealing the genuine emotions that people attempt to hide. Therefore, they can provide important …
Survey