paper-with-me

Papers

SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches

2024-07-13 · Kushan Choksi, Hongkai Chen, Karan Joshi, Sukrutha Jade, Shahriar Nirjon, Shan Lin

Recent research has demonstrated the capability of physiological signals to infer both user emotional and attention responses. This presents an opportunity for leveraging widely available physiological sensors in smartwatches, to detect real-time emotional cues in users, such as stress and excitement. In this paper, we introduce SensEmo, a smartwatch-based system designed for affective learning. SensEmo utilizes multiple physiological sensor data, including heart rate and galvanic skin response, to recognize a student's motivation and concentration levels during class. This recognition is facilitated by a personalized emotion recognition model that predicts emotional states based on degrees of valence and arousal. With real-time emotion and attention feedback from students, we design a Markov decision process-based algorithm to enhance student learning effectiveness and experience by by offering suggestions to the teacher regarding teaching content and pacing. We evaluate SensEmo with 22 participants in real-world classroom environments. Evaluation results show that SensEmo recognizes student emotion with an average of 88.9% accuracy. More importantly, SensEmo assists students to achieve better online learning outcomes, e.g., an average of 40.0% higher grades in quizzes, over the traditional learning without student emotional feedback.

📄 PDF Abstract BibTeX arXiv:2407.09911

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion Recognition

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Physiological and Affective Computing through Thermal Imaging: A Survey

2019-08-27 · Youngjun Cho, Nadia Bianchi-Berthouze

Thermal imaging-based physiological and affective computing is an emerging research area enabling technologies to monitor our bodily functions and understand psychological and affective needs in a contactless manner. How…

Physiological ComputingSurvey

Are Manually Prepared Affective Lexicons Really Useful for Sentiment Analysis

2017-11-01 · IJCNLP 2017 11 · Minglei Li, Qin Lu, Yunfei Long

In this paper, we investigate the effectiveness of different affective lexicons through sentiment analysis of phrases. We examine how phrases can be represented through manually prepared lexicons, extended lexicons using…

Semantic Textual SimilaritySentiment Analysis

Causal affect prediction model using a facial image sequence

2021-07-08 · Geesung Oh, Euiseok Jeong, Sejoon Lim

Among human affective behavior research, facial expression recognition research is improving in performance along with the development of deep learning. However, for improved performance, not only past images but also fu…

Causal InferenceFacial Expression RecognitionFacial Expression Recognition (FER)Prediction

Robotic Affection -- Opportunities of AI-based haptic interactions to improve social robotic touch through a multi-deep-learning approach

2026-05-04 · Ali Askari, Jens Gerken arxiv

Despite the advancement in robotic grasping and dexterity through haptic information, affective social touch, such as handshaking or reassuring stroking, remains a major challenge in Human-Robot-Interaction. This positio…

Robotic Grasping

Memory Bear AI Memory Science Engine for Multimodal Affective Intelligence: A Technical Report

2026-03-18 · Deliang Wen, Ke Sun, Yu Wang arxiv

Affective judgment in real interaction is rarely a purely local prediction problem. Emotional meaning often depends on prior trajectory, accumulated context, and multimodal evidence that may be weak, noisy, or incomplete…

Multimodal Emotion Recognition