Facial Action Unit Detection using 3D Facial Landmarks
In this paper, we propose to detect facial action units (AU) using 3D facial landmarks. Specifically, we train a 2D convolutional neural network (CNN) on 3D facial landmarks, tracked using a shape index-based statistical shape model, for binary and multi-class AU detection. We show that the proposed approach is able to accurately model AU occurrences, as the movement of the facial landmarks corresponds directly to the movement of the AUs. By training a CNN on 3D landmarks, we can achieve accurate AU detection on two state-of-the-art emotion datasets, namely BP4D and BP4D+. Using the proposed method, we detect multiple AUs on over 330,000 frames, reporting improved results over state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Unit DetectionFacial Action Unit DetectionSimilar Papers 제목 키워드 기반
Features Extraction Based on an Origami Representation of 3D Landmarks
Feature extraction analysis has been widely investigated during the last decades in computer vision community due to the large range of possible applications. Significant work has been done in order to improve the perfor…
ClassificationEmotion ClassificationGeneral ClassificationAutomatic Facial Paralysis Estimation with Facial Action Units
Facial palsy is unilateral facial nerve weakness or paralysis of rapid onset with unknown causes. Automatically estimating facial palsy severeness can be helpful for the diagnosis and treatment of people suffering from i…
EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detection
In this paper, we propose a deep learning based approach for facial action unit detection by enhancing and cropping the regions of interest. The approach is implemented by adding two novel nets (layers): the enhancing la…
Action Unit DetectionFacial Action Unit DetectionDetecting facial landmarks in the video based on a hybrid framework
To dynamically detect the facial landmarks in the video, we propose a novel hybrid framework termed as detection-tracking-detection (DTD). First, the face bounding box is achieved from the first frame of the video sequen…
Face DetectionCatFLW: Cat Facial Landmarks in the Wild Dataset
Animal affective computing is a quickly growing field of research, where only recently first efforts to go beyond animal tracking into recognizing their internal states, such as pain and emotions, have emerged. In most m…