paper-with-me

홈 › Papers

Affect Recognition in Conversations Using Large Language Models

2023-09-22 · Shutong Feng, Guangzhi Sun, Nurul Lubis, Wen Wu, Chao Zhang, Milica Gašić

Affect recognition, encompassing emotions, moods, and feelings, plays a pivotal role in human communication. In the realm of conversational artificial intelligence, the ability to discern and respond to human affective cues is a critical factor for creating engaging and empathetic interactions. This study investigates the capacity of large language models (LLMs) to recognise human affect in conversations, with a focus on both open-domain chit-chat dialogues and task-oriented dialogues. Leveraging three diverse datasets, namely IEMOCAP (Busso et al., 2008), EmoWOZ (Feng et al., 2022), and DAIC-WOZ (Gratch et al., 2014), covering a spectrum of dialogues from casual conversations to clinical interviews, we evaluate and compare LLMs' performance in affect recognition. Our investigation explores the zero-shot and few-shot capabilities of LLMs through in-context learning as well as their model capacities through task-specific fine-tuning. Additionally, this study takes into account the potential impact of automatic speech recognition errors on LLM predictions. With this work, we aim to shed light on the extent to which LLMs can replicate human-like affect recognition capabilities in conversations.

📄 PDF Abstract BibTeX arXiv:2309.12881

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)In-Context Learningspeech-recognitionSpeech Recognition

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Affective-NLI: Towards Accurate and Interpretable Personality Recognition in Conversation

2024-04-03 · Zhiyuan Wen, Jiannong Cao, Yu Yang, Ruosong Yang 외

Personality Recognition in Conversation (PRC) aims to identify the personality traits of speakers through textual dialogue content. It is essential for providing personalized services in various applications of Human-Com…

Emotion RecognitionLanguage ModellingNatural Language InferencePersonality Recognition in Conversation

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations

2018-10-05 · ACL 2019 7 · Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Gautam Naik 외

Emotion recognition in conversations is a challenging task that has recently gained popularity due to its potential applications. Until now, however, a large-scale multimodal multi-party emotional conversational database…

Dialogue GenerationEmotion RecognitionEmotion Recognition in Conversation

Efficient ASR Training with Conversations that Never Happened

2026-06-02 · Máté Gedeon, Péter Mihajlik arxiv

Conversational ASR for lower-resource languages and niche domains is limited by the scarcity of domain-matched multi-speaker training data. We propose an augmentation pipeline that generates scenario-level dialogues with…

Speech Recognition

Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?

2025-08-07 · Burak Can Kaplan, Hugo Cesar De Castro Carneiro, Stefan Wermter arxiv

Emotion recognition in conversations (ERC) focuses on identifying emotion shifts within interactions, representing a significant step toward advancing machine intelligence. However, ERC data remains scarce, and existing …

Emotion Recognition

Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry

2026-09-09 · Oriol Marín, Roger Marí, Gloria Haro, Rafael Redondo arxiv

Emotion Recognition in Conversations (ERC) requires integrating heterogeneous textual, audio, and visual cues while accounting for conversational context and emotional dynamics. We extend the Self-Distillation Transforme…

Multimodal Emotion Recognition