Occlusion Aware Student Emotion Recognition based on Facial Action Unit Detection
Given that approximately half of science, technology, engineering, and mathematics (STEM) undergraduate students in U.S. colleges and universities leave by the end of the first year [15], it is crucial to improve the quality of classroom environments. This study focuses on monitoring students' emotions in the classroom as an indicator of their engagement and proposes an approach to address this issue. The impact of different facial parts on the performance of an emotional recognition model is evaluated through experimentation. To test the proposed model under partial occlusion, an artificially occluded dataset is introduced. The novelty of this work lies in the proposal of an occlusion-aware architecture for facial action units (AUs) extraction, which employs attention mechanism and adaptive feature learning. The AUs can be used later to classify facial expressions in classroom settings. This research paper's findings provide valuable insights into handling occlusion in analyzing facial images for emotional engagement analysis. The proposed experiments demonstrate the significance of considering occlusion and enhancing the reliability of facial analysis models in classroom environments. These findings can also be extended to other settings where occlusions are prevalent.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Unit DetectionEmotion RecognitionFacial Action Unit DetectionSimilar Papers 제목 키워드 기반
Context-Aware Academic Emotion Dataset and Benchmark
Academic emotion analysis plays a crucial role in evaluating students' engagement and cognitive states during the learning process. This paper addresses the challenge of automatically recognizing academic emotions throug…
Facial Expression RecognitionEmotion RecognitionPERI: Part Aware Emotion Recognition In The Wild
Emotion recognition aims to interpret the emotional states of a person based on various inputs including audio, visual, and textual cues. This paper focuses on emotion recognition using visual features. To leverage the c…
Emotion RecognitionClassifying emotions and engagement in online learning based on a single facial expression recognition neural network
In this paper, behaviour of students in the e-learning environment is analyzed. The novel pipeline is proposed based on video facial processing. At first, face detection, tracking and clustering techniques are applied to…
Efficient Neural NetworkEmotion RecognitionFace DetectionFace Identification+2A survey of smart classroom: Concept, technologies and facial emotions recognition application
Technology has transformed traditional educational systems around the globe; integrating digital learning tools into classrooms offers students better opportunities to learn efficiently and allows the teacher to transfer…
Emotion RecognitionFacial Emotion RecognitionRobust Lightweight Facial Expression Recognition Network with Label Distribution Training
This paper presents an efficiently robust facial expression recognition (FER) network, named EfficientFace, which holds much fewer parameters but more robust to the FER in the wild. Firstly, to improve the robustness of …
Facial Expression Recognition (FER)