A Recursive Framework for Expression Recognition: From Web Images to Deep Models to Game Dataset
In this paper, we propose a recursive framework to recognize facial expressions from images in real scenes. Unlike traditional approaches that typically focus on developing and refining algorithms for improving recognition performance on an existing dataset, we integrate three important components in a recursive manner: facial dataset generation, facial expression recognition model building, and interactive interfaces for testing and new data collection. To start with, we first create a candid-images-for-facial-expression (CIFE) dataset. We then apply a convolutional neural network (CNN) to CIFE and build a CNN model for web image expression classification. In order to increase the expression recognition accuracy, we also fine-tune the CNN model and thus obtain a better CNN facial expression recognition model. Based on the fine-tuned CNN model, we design a facial expression game engine and collect a new and more balanced dataset, GaMo. The images of this dataset are collected from the different expressions our game users make when playing the game. Finally, we evaluate the GaMo and CIFE datasets and show that our recursive framework can help build a better facial expression model for dealing with real scene facial expression tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Dataset GenerationFacial Expression RecognitionFacial Expression Recognition (FER)Similar Papers 제목 키워드 기반
Real-time Facial Expression Recognition "In The Wild'' by Disentangling 3D Expression from Identity
Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactiv…
Emotion RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)Discourse Relation Recognition by Comparing Various Units of Sentence Expression with Recursive Neural Network
Mutual Information Regularized Identity-aware Facial ExpressionRecognition in Compressed Video
How to extract effective expression representations that invariant to the identity-specific attributes is a long-lasting problem for facial expression recognition (FER). Most of the previous methods process the RGB image…
Face RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)Stroke extraction for offline handwritten mathematical expression recognition
Offline handwritten mathematical expression recognition is often considered much harder than its online counterpart due to the absence of temporal information. In order to take advantage of the more mature methods for on…
Optical Character RecognitionOptical Character Recognition (OCR)Interpretable Explainability in Facial Emotion Recognition and Gamification for Data Collection
Training facial emotion recognition models requires large sets of data and costly annotation processes. To alleviate this problem, we developed a gamified method of acquiring annotated facial emotion data without an expl…
Emotion RecognitionFacial Emotion Recognition