paper-with-me

Papers

A Multimodal Emotion Recognition System: Integrating Facial Expressions, Body Movement, Speech, and Spoken Language

2024-12-23 · Kris Kraack

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition system that provides a standardised, objective, and data-driven tool to support evaluators, such as psychologists, psychiatrists, and clinicians. The system integrates recognition of facial expressions, speech, spoken language, and body movement analysis to capture subtle emotional cues that are often overlooked in human evaluations. By combining these modalities, the system provides more robust and comprehensive emotional state assessment, reducing the risk of mis- and overdiagnosis. Preliminary testing in a simulated real-world condition demonstrates the system's potential to provide reliable emotional insights to improve the diagnostic accuracy. This work highlights the promise of automated multimodal analysis as a valuable complement to traditional psychological evaluation practices, with applications in clinical and therapeutic settings.

📄 PDF Abstract BibTeX arXiv:2412.17907

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticEmotion RecognitionMultimodal Emotion Recognition

Similar Papers 제목 키워드 기반

MicroEmo: Time-Sensitive Multimodal Emotion Recognition with Micro-Expression Dynamics in Video Dialogues

2024-07-23 · Liyun Zhang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable multimodal emotion recognition capabilities, integrating multimodal cues from visual, acoustic, and linguistic contexts in the video to recognize huma…

Emotion RecognitionMultimodal Emotion Recognition

MMDS: A Multimodal Medical Diagnosis System Integrating Image Analysis and Knowledge-based Departmental Consultation

2024-10-20 · Yi Ren, Hanzhi Zhang, Weibin Li, Jun Fu 외

We present MMDS, a system capable of recognizing medical images and patient facial details, and providing professional medical diagnoses. The system consists of two core components:The first component is the analysis of …

Emotion RecognitionFacial Emotion RecognitionLanguage ModelingLanguage Modelling+6

Multimodal Representation Learning Techniques for Comprehensive Facial State Analysis

2025-04-14 · Kaiwen Zheng, Xuri Ge, Junchen Fu, Jun Peng 외

Multimodal foundation models have significantly improved feature representation by integrating information from multiple modalities, making them highly suitable for a broader set of applications. However, the exploration…

Emotion RecognitionRepresentation Learning

Milmer: a Framework for Multiple Instance Learning based Multimodal Emotion Recognition

2025-02-01 · Zaitian Wang, Jian He, Yu Liang, Xiyuan Hu 외

Emotions play a crucial role in human behavior and decision-making, making emotion recognition a key area of interest in human-computer interaction (HCI). This study addresses the challenges of emotion recognition by int…

EEGElectroencephalogram (EEG)Emotion RecognitionMultimodal Emotion Recognition+1

A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations

2023-07-01 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2023 7 · Wenjie Zheng, Jianfei Yu, Rui Xia, Shijin Wang

Multimodal Emotion Recognition in Multiparty Conversations (MERMC) has recently attracted considerable attention. Due to the complexity of visual scenes in multi-party conversations, most previous MERMC studies mainly fo…

Emotion RecognitionEmotion Recognition in ConversationFacial Expression Recognition (FER)Multimodal Emotion Recognition+1