paper-with-me

홈 › Papers

Emotion-Aware Interaction Design in Intelligent User Interface Using Multi-Modal Deep Learning

2024-11-10 · Shiyu Duan, Ziyi Wang, Shixiao Wang, Mengmeng Chen, Runsheng Zhang

In an era where user interaction with technology is ubiquitous, the importance of user interface (UI) design cannot be overstated. A well-designed UI not only enhances usability but also fosters more natural, intuitive, and emotionally engaging experiences, making technology more accessible and impactful in everyday life. This research addresses this growing need by introducing an advanced emotion recognition system to significantly improve the emotional responsiveness of UI. By integrating facial expressions, speech, and textual data through a multi-branch Transformer model, the system interprets complex emotional cues in real-time, enabling UIs to interact more empathetically and effectively with users. Using the public MELD dataset for validation, our model demonstrates substantial improvements in emotion recognition accuracy and F1 scores, outperforming traditional methods. These findings underscore the critical role that sophisticated emotion recognition plays in the evolution of UIs, making technology more attuned to user needs and emotions. This study highlights how enhanced emotional intelligence in UIs is not only about technical innovation but also about fostering deeper, more meaningful connections between users and the digital world, ultimately shaping how people interact with technology in their daily lives.

📄 PDF Abstract BibTeX arXiv:2411.06326

Code (0)

등록된 구현이 없습니다.

Tasks

Emotional IntelligenceEmotion Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue

2026-04-10 · Jiawen Deng, Wei Li, Wentao Zhang, Ziyun Jiao 외 arxiv

Intelligent dialogue systems are increasingly deployed in emotionally and ethically sensitive settings, where failures in either emotional attunement or ethical judgment can cause significant harm. Existing dialogue mode…

Emotionally Intelligent Task-oriented Dialogue Systems: Architecture, Representation, and Optimisation

2025-07-02 · Shutong Feng, Hsien-chin Lin, Nurul Lubis, Carel van Niekerk 외 arxiv

Task-oriented dialogue (ToD) systems are designed to help users achieve specific goals through natural language interaction. While recent advances in large language models (LLMs) have significantly improved linguistic fl…

Task-Oriented Dialogue SystemsNatural Language Understanding

The Emotion-Memory Link: Do Memorability Annotations Matter for Intelligent Systems?

2025-07-18 · Maria Tsfasman, Ramin Ghorbani, Catholijn M. Jonker, Bernd Dudzik arxiv

Humans have a selective memory, remembering relevant episodes and forgetting the less relevant information. Possessing awareness of event memorability for a user could help intelligent systems in more accurate user model…

Emotion Recognition

Livia: An Emotion-Aware AR Companion Powered by Modular AI Agents and Progressive Memory Compression

2025-08-12 · Rui Xi, Xianghan Wang arxiv

Loneliness and social isolation pose significant emotional and health challenges, prompting the development of technology-based solutions for companionship and emotional support. This paper introduces Livia, an emotion-a…

Dialogue Generation

User Centered Design (VI): Human Factors Approaches for Intelligent Human-Computer Interaction

2021-11-08 · Wei Xu

Starting from the design philosophy of "user-centered design", this paper analyzes the human factors characteristics of intelligent human-computer interaction (iHCI) and proposes a concept of "user-oriented iHCI". The pa…

Intent DetectionPhilosophy