Micro-Expression Recognition Based on Attribute Information Embedding and Cross-modal Contrastive Learning
Facial micro-expressions recognition has attracted much attention recently. Micro-expressions have the characteristics of short duration and low intensity, and it is difficult to train a high-performance classifier with the limited number of existing micro-expressions. Therefore, recognizing micro-expressions is a challenge task. In this paper, we propose a micro-expression recognition method based on attribute information embedding and cross-modal contrastive learning. We use 3D CNN to extract RGB features and FLOW features of micro-expression sequences and fuse them, and use BERT network to extract text information in Facial Action Coding System. Through cross-modal contrastive loss, we embed attribute information in the visual network, thereby improving the representation ability of micro-expression recognition in the case of limited samples. We conduct extensive experiments in CASME II and MMEW databases, and the accuracy is 77.82% and 71.04%, respectively. The comparative experiments show that this method has better recognition effect than other methods for micro-expression recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeContrastive LearningMicro Expression RecognitionMicro-Expression RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection
Recently, there are increasing interests in inferring mirco-expression from facial image sequences. Due to subtle facial movement of micro-expressions, feature extraction has become an important and critical issue for sp…
Attributefeature selectionMicro Expression RecognitionMicro-Expression RecognitionMMNet: Muscle motion-guided network for micro-expression recognition
Facial micro-expressions (MEs) are involuntary facial motions revealing peoples real feelings and play an important role in the early intervention of mental illness, the national security, and many human-computer interac…
Micro Expression RecognitionMicro-Expression RecognitionPositionMicro-expression recognition based on depth map to point cloud
Micro-expressions are nonverbal facial expressions that reveal the covert emotions of individuals, making the micro-expression recognition task receive widespread attention. However, the micro-expression recognition task…
Micro Expression RecognitionMicro-Expression RecognitionSpontaneous Facial Micro-Expression Recognition using 3D Spatiotemporal Convolutional Neural Networks
Facial expression recognition in videos is an active area of research in computer vision. However, fake facial expressions are difficult to be recognized even by humans. On the other hand, facial micro-expressions genera…
Facial Expression RecognitionFacial Expression Recognition (FER)Micro Expression RecognitionMicro-Expression RecognitionA Novel Apex-Time Network for Cross-Dataset Micro-Expression Recognition
The automatic recognition of micro-expression has been boosted ever since the successful introduction of deep learning approaches. As researchers working on such topics are moving to learn from the nature of micro-expres…
Deep LearningMicro Expression RecognitionMicro-Expression Recognition