paper-with-me

홈 › Papers

Emotion Detection on User Front-Facing App Interfaces for Enhanced Schedule Optimization: A Machine Learning Approach

2025-06-24 · Feiting Yang, Antoine Moevus, Steve Lévesque

Human-Computer Interaction (HCI) has evolved significantly to incorporate emotion recognition capabilities, creating unprecedented opportunities for adaptive and personalized user experiences. This paper explores the integration of emotion detection into calendar applications, enabling user interfaces to dynamically respond to users' emotional states and stress levels, thereby enhancing both productivity and engagement. We present and evaluate two complementary approaches to emotion detection: a biometric-based method utilizing heart rate (HR) data extracted from electrocardiogram (ECG) signals processed through Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) neural networks to predict the emotional dimensions of Valence, Arousal, and Dominance; and a behavioral method analyzing computer activity through multiple machine learning models to classify emotions based on fine-grained user interactions such as mouse movements, clicks, and keystroke patterns. Our comparative analysis, from real-world datasets, reveals that while both approaches demonstrate effectiveness, the computer activity-based method delivers superior consistency and accuracy, particularly for mouse-related interactions, which achieved approximately 90\% accuracy. Furthermore, GRU networks outperformed LSTM models in the biometric approach, with Valence prediction reaching 84.38\% accuracy.

📄 PDF Abstract BibTeX arXiv:2506.19280

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion Recognition

Methods 이 논문이 사용한 방법론

GRU A Gated Recurrent Unit, or GRU, is a type of recurrent neural network. It is similar to an LSTM, but only has two gates - a reset…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

A Real Time Facial Expression Classification System Using Local Binary Patterns

2015-05-15 · S. L. Happy, Anjith George, Aurobinda Routray

Facial expression analysis is one of the popular fields of research in human computer interaction (HCI). It has several applications in next generation user interfaces, human emotion analysis, behavior and cognitive mode…

Emotion RecognitionFace DetectionGeneral Classification

Multi-face emotion detection for effective Human-Robot Interaction

2025-01-13 · Mohamed Ala Yahyaoui, Mouaad Oujabour, Leila Ben Letaifa, Amine Bohi

The integration of dialogue interfaces in mobile devices has become ubiquitous, providing a wide array of services. As technology progresses, humanoid robots designed with human-like features to interact effectively with…

Emotion RecognitionFacial Expression Recognition

Deep Feature-based Face Detection on Mobile Devices

2016-02-16 · Sayantan Sarkar, Vishal M. Patel, Rama Chellappa

We propose a deep feature-based face detector for mobile devices to detect user's face acquired by the front facing camera. The proposed method is able to detect faces in images containing extreme pose and illumination v…

Face Detection

Frontend Diffusion: Exploring Intent-Based User Interfaces through Abstract-to-Detailed Task Transitions

2024-07-16 · Qinshi Zhang, Latisha Besariani Hendra, Mohan Chi, Zijian Ding

The emergence of Generative AI is catalyzing a paradigm shift in user interfaces from command-based to intent-based outcome specification. In this paper, we explore abstract-to-detailed task transitions in the context of…

Code Generation

Multi-Camera Lighting Estimation for Photorealistic Front-Facing Mobile Augmented Reality

2023-01-15 · Yiqin Zhao, Sean Fanello, Tian Guo

Lighting understanding plays an important role in virtual object composition, including mobile augmented reality (AR) applications. Prior work often targets recovering lighting from the physical environment to support ph…

Lighting EstimationVirtual Try-on