Spotting micro-movements in image sequence by introducing intelligent cubic-LBP
Invisible to naked human eyes, micro-movements are barely noticeable. There are wide ranges of micro-movement applications from spotting subtle changes in a volcano, vascular pulse, and blood vessel to micro-expression detection. In the latter, some evil thoughts can be unveiled, resulting in identifying crooks and lawbreakers and it arises from involuntary subtle and short-duration of facial muscles movements. Precise spotting of these tiny movements is possible only when multiple aspects of temporal images are scrutinized. Meanwhile, since motions often happen in one or two directions, it is rudimentary to extract complete feature sets in textural-based approaches such as cubic Local Binary Pattern (cubic-LBP). Approaches like cubic-LBP also have imposed an unnecessary computation burden. Hence, in this research, a novel method named intelligent cubic-LBP is proposed, which incorporates Convolutional Neural Network (CNN) model. This model learns to select the useful plane(s) automatically. Apex is then detected by applying Partial Autocorrelation Coefficient (PACF) on the selected plane(s). The experimental results show significant improvement in micro-movements identification. The accuracy of the apex frame detection has elevated to 10% and 17% in the Chinese Academy of Sciences Micro-Expressions (CASME) and the CASME II databases, respectively.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Facial Micro-Expression Spotting and Recognition using Time Contrasted Feature with Visual Memory
Facial micro-expressions are sudden involuntary minute muscle movements which reveal true emotions that people try to conceal. Spotting a micro-expression and recognizing it is a major challenge owing to its short durati…
Micro-Expression SpottingSpotFormer: Multi-Scale Spatio-Temporal Transformer for Facial Expression Spotting
Facial expression spotting, identifying periods where facial expressions occur in a video, is a significant yet challenging task in facial expression analysis. The issues of irrelevant facial movements and the challenge …
Contrastive LearningMicro-Expression SpottingOptical Flow EstimationSpotting Macro- and Micro-expression Intervals in Long Video Sequences
This paper presents baseline results for the Third Facial Micro-Expression Grand Challenge (MEGC 2020). Both macro- and micro-expression intervals in CAS(ME)$^2$ and SAMM Long Videos are spotted by employing the method o…
Micro-Expression SpottingOptical Flow EstimationAutomatic micro-expression apex spotting using Cubic-LBP
The main way to communicate is through non-verbal expressions, although it could totally be manipulated by the person to give false expression. Unlike ordinary facial expressions, facial micro-expression has characterize…
Synergistic Spotting and Recognition of Micro-Expression via Temporal State Transition
Micro-expressions are involuntary facial movements that cannot be consciously controlled, conveying subtle cues with substantial real-world applications. The analysis of micro-expressions generally involves two main task…
Classification