paper-with-me

Papers

Hi-EF: Benchmarking Emotion Forecasting in Human-interaction

2024-07-23 · Haoran Wang, Xinji Mai, Zeng Tao, Yan Wang, Jiawen Yu, Ziheng Zhou, Xuan Tong, Shaoqi Yan, Qing Zhao, Shuyong Gao, Wenqiang Zhang

Affective Forecasting, a research direction in psychology that predicts individuals future emotions, is often constrained by numerous external factors like social influence and temporal distance. To address this, we transform Affective Forecasting into a Deep Learning problem by designing an Emotion Forecasting paradigm based on two-party interactions. We propose a novel Emotion Forecasting (EF) task grounded in the theory that an individuals emotions are easily influenced by the emotions or other information conveyed during interactions with another person. To tackle this task, we have developed a specialized dataset, Human-interaction-based Emotion Forecasting (Hi-EF), which contains 3069 two-party Multilayered-Contextual Interaction Samples (MCIS) with abundant affective-relevant labels and three modalities. Hi-EF not only demonstrates the feasibility of the EF task but also highlights its potential. Additionally, we propose a methodology that establishes a foundational and referential baseline model for the EF task and extensive experiments are provided. The dataset and code is available at https://github.com/Anonymize-Author/Hi-EF.

📄 PDF Abstract BibTeX arXiv:2407.16406

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking

Similar Papers 제목 키워드 기반

The ICASSP 2026 HumDial Challenge: Benchmarking Human-like Spoken Dialogue Systems in the LLM Era

2026-01-09 · Zhixian Zhao, Shuiyuan Wang, Guojian Li, Hongfei Xue 외 arxiv

Driven by the rapid advancement of Large Language Models (LLMs), particularly Audio-LLMs and Omni-models, spoken dialogue systems have evolved significantly, progressively narrowing the gap between human-machine and huma…

Emotional Intelligence

EMO-Reasoning: Benchmarking Emotional Reasoning Capabilities in Spoken Dialogue Systems

2025-08-25 · Jingwen Liu, Kan Jen Cheng, Jiachen Lian, Akshay Anand 외 arxiv

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reason…

Emo3D: Metric and Benchmarking Dataset for 3D Facial Expression Generation from Emotion Description

2024-10-02 · Mahshid Dehghani, Amirahmad Shafiee, Ali Shafiei, Neda Fallah 외

Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of huma…

BenchmarkingFacial expression generation

EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Models

2025-02-06 · He Hu, Yucheng Zhou, Lianzhong You, Hongbo Xu 외

With the integration of Multimodal large language models (MLLMs) into robotic systems and various AI applications, embedding emotional intelligence (EI) capabilities into these models is essential for enabling robots to …

BenchmarkingEmotional IntelligenceEmotion Recognition

Contact-aware Human Motion Forecasting

2022-10-08 · Wei Mao, Miaomiao Liu, Richard Hartley, Mathieu Salzmann

In this paper, we tackle the task of scene-aware 3D human motion forecasting, which consists of predicting future human poses given a 3D scene and a past human motion. A key challenge of this task is to ensure consistenc…

Human Pose ForecastingMotion Forecasting