Facial Expression Spotting Based on Optical Flow Features
The purpose of micro expression (ME) and macro expression (MaE) spotting task is to locate the onset and offset frames of MaE and ME clips. Compared with MaEs, MEs are shorter in duration and lower in intensity, which makes MEs harder to be spotted. In this paper, we propose an efficient pipeline based on optical flow features to spot MEs and MaEs. We crop and align the faces and select the eyebrows area, nose area, and mouth area as our regions of interest to exclude the interference of extraneous factors on the face expression representation. Then, we extract the optical flow in these regions and enhance the features of the expressions in the optical flow with low-pass filter and EMD method. Finally, the sliding window method is used to locate the peaks of optical flow features and get the intervals containing MEs or MaEs. We evaluate the performance of our method on the MEGC2022-TestSet including 10 long videos from SAMM and CAS(ME)3 and achieve the first place in the MEGC2022 Challenge. The results prove the effectiveness of our method.
Code (1)
Tasks
Optical Flow EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SpotFormer: Multi-Scale Spatio-Temporal Transformer for Facial Expression Spotting
Facial expression spotting, identifying periods where facial expressions occur in a video, is a significant yet challenging task in facial expression analysis. The issues of irrelevant facial movements and the challenge …
Contrastive LearningMicro-Expression SpottingOptical Flow Estimation3D-CNN for Facial Micro- and Macro-expression Spotting on Long Video Sequences using Temporal Oriented Reference Frame
Facial expression spotting is the preliminary step for micro- and macro-expression analysis. The task of reliably spotting such expressions in video sequences is currently unsolved. The current best systems depend upon o…
Micro-Expression SpottingOptical Flow EstimationRMES: Real-Time Micro-Expression Spotting Using Phase From Riesz Pyramid
Micro-expressions (MEs) are involuntary and subtle facial expressions that are thought to reveal feelings people are trying to hide. ME spotting detects the temporal intervals containing MEs in videos. Detecting such qui…
Micro-Expression SpottingOptical Flow EstimationShallow Optical Flow Three-Stream CNN for Macro- and Micro-Expression Spotting from Long Videos
Facial expressions vary from the visible to the subtle. In recent years, the analysis of micro-expressions $-$ a natural occurrence resulting from the suppression of one's true emotions, has drawn the attention of resear…
Micro-Expression SpottingOptical Flow EstimationSpotting Macro- and Micro-expression Intervals in Long Video Sequences
This paper presents baseline results for the Third Facial Micro-Expression Grand Challenge (MEGC 2020). Both macro- and micro-expression intervals in CAS(ME)$^2$ and SAMM Long Videos are spotted by employing the method o…
Micro-Expression SpottingOptical Flow Estimation