HiCOMEX: Facial Action Unit Recognition Based on Hierarchy Intensity Distribution and COMEX Relation Learning

2020-09-23 · Ziqiang Shi, Liu Liu, Zhongling Liu, Rujie Liu, Xiaoyu Mi, and Kentaro Murase

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the \textbf{c}o-\textbf{o}ccurrence and \textbf{m}utual \textbf{ex}clusion (COMEX) as well as the intensity distribution among AUs. Our algorithm uses facial landmarks to detect the features of local AUs. The features are input to a bidirectional long short-term memory (BiLSTM) layer for learning the intensity distribution. Afterwards, the new AU feature continuously passed through a self-attention encoding layer and a continuous-state modern Hopfield layer for learning the COMEX relationships. Our experiments on the challenging BP4D and DISFA benchmarks without any external data or pre-trained models yield F1-scores of 63.7\% and 61.8\% respectively, which shows our proposed networks can lead to performance improvement in the AU detection task.

📄 PDF Abstract BibTeX arXiv:2009.10892

Code (0)

등록된 구현이 없습니다.

Tasks

Action Unit Detection Facial Action Unit DetectionRelationRepresentation Learning

Methods 이 논문이 사용한 방법론

Hopfield Layer A Hopfield Layer is a module that enables a network to associate two sets of vectors. This general functionality allows for…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Facial Action Unit Recognition Based on Transfer Learning

2022-03-25 · Shangfei Wang, Yanan Chang, Jiahe Wang

Facial action unit recognition is an important task for facial analysis. Owing to the complex collection environment, facial action unit recognition in the wild is still challenging. The 3rd competition on affective beha…

Facial Action Unit Detection Transfer Learning

Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection

2017-09-23 · CVPR 2016 6 · Yue Wu, Qiang Ji

Cascade regression framework has been shown to be effective for facial landmark detection. It starts from an initial face shape and gradually predicts the face shape update from the local appearance features to generate …

Facial Action Unit Detection Facial Landmark Detection regression

3D Facial Action Units Recognition for Emotional Expression

2017-12-01 · N. Hussain, H. Ujir, I. Hipiny, J-L Minoi

The muscular activities caused the activation of certain AUs for every facial expression at the certain duration of time throughout the facial expression. This paper presents the methods to recognise facial Action Unit (…

General Classification

Exploring Adversarial Learning for Deep Semi-Supervised Facial Action Unit Recognition

2021-06-04 · Shangfei Wang, Yanan Chang, Guozhu Peng, Bowen Pan

Current works formulate facial action unit (AU) recognition as a supervised learning problem, requiring fully AU-labeled facial images during training. It is challenging if not impossible to provide AU annotations for la…

Facial Action Unit Detection

Leveraging Previous Facial Action Units Knowledge for Emotion Recognition on Faces

2023-11-20 · Pietro B. S. Masur, Willams Costa, Lucas S. Figueredo, Veronica Teichrieb

People naturally understand emotions, thus permitting a machine to do the same could open new paths for human-computer interaction. Facial expressions can be very useful for emotion recognition techniques, as these are t…

Emotion Recognition