paper-with-me

Papers

EmoMeta: A Multimodal Dataset for Fine-grained Emotion Classification in Chinese Metaphors

2025-05-12 · Xingyuan Lu, Yuxi Liu, Dongyu Zhang, Zhiyao Wu, Jing Ren, Feng Xia

Metaphors play a pivotal role in expressing emotions, making them crucial for emotional intelligence. The advent of multimodal data and widespread communication has led to a proliferation of multimodal metaphors, amplifying the complexity of emotion classification compared to single-mode scenarios. However, the scarcity of research on constructing multimodal metaphorical fine-grained emotion datasets hampers progress in this domain. Moreover, existing studies predominantly focus on English, overlooking potential variations in emotional nuances across languages. To address these gaps, we introduce a multimodal dataset in Chinese comprising 5,000 text-image pairs of metaphorical advertisements. Each entry is meticulously annotated for metaphor occurrence, domain relations and fine-grained emotion classification encompassing joy, love, trust, fear, sadness, disgust, anger, surprise, anticipation, and neutral. Our dataset is publicly accessible (https://github.com/DUTIR-YSQ/EmoMeta), facilitating further advancements in this burgeoning field.

📄 PDF Abstract BibTeX arXiv:2505.13483

Code (1)

dutir-ysq/emometa 공식 구현

Tasks

Emotional IntelligenceEmotion Classification

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Multilevel Transformer For Multimodal Emotion Recognition

2022-10-26 · Junyi He, Meimei Wu, Meng Li, Xiaobo Zhu 외

Multimodal emotion recognition has attracted much attention recently. Fusing multiple modalities effectively with limited labeled data is a challenging task. Considering the success of pre-trained model and fine-grained …

Emotion RecognitionMultimodal Emotion Recognition

Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition

2026-05-16 · Zeheng Wang, Bo Zhao, Yijie Zhu, Zhishu Liu 외 arxiv

Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states. Although multimodal large language models excel at multimodal reasoning, they typically treat emotion …

Multimodal Emotion RecognitionEmotion ClassificationMultimodal Reasoning

Gems: Group Emotion Profiling Through Multimodal Situational Understanding

2025-07-30 · Anubhav Kataria, Surbhi Madan, Shreya Ghosh, Tom Gedeon 외 arxiv

Understanding individual, group and event level emotions along with contextual information is crucial for analyzing a multi-person social situation. To achieve this, we frame emotion comprehension as the task of predicti…

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

2024-06-17 · Zebang Cheng, Zhi-Qi Cheng, Jun-Yan He, Jingdong Sun 외

Accurate emotion perception is crucial for various applications, including human-computer interaction, education, and counseling. However, traditional single-modality approaches often fail to capture the complexity of re…

Emotion RecognitionMultimodal Emotion Recognition

EmoS: A High-Fidelity Multimodal Benchmark for Fine-grained Streaming Emotional Understanding

2026-05-09 · Pengze Guo, Jingxi Liang, Zhiwen Xie, Qifeng Wang 외 arxiv

In the context of today's high-pressure, aging society, the demand for large-scale emotional models capable of providing empathetic support is more critical than ever. However, existing benchmarks fail to simultaneously …

Emotion Recognition