Emotion Flip Reasoning in Multiparty Conversations
Emotion plays a major role in conversation analysis. To understand the emotional dynamics of the speakers in a conversation, it is imperative to reason out any change/flip of the emotion of a particular speaker. In this paper, we introduce a novel task -- Emotion Flip Reasoning (aka EFR) that aims to find a rationale or instigator behind the emotion flip of a speaker within a conversational dialog, e.g., joy --> anger. To this end, we introduce MELD-I, a new dataset with ground-truth EFR instigator labels. Following emotion psychology, we define 27 instigator labels in a hierarchical fashion - the coarse-grained set contains 14 instigators, while the fine-grained set comprises all 27 instigators. To benchmark the dataset, we propose TGIF, an efficient neural architecture that captures the dialog context, speaker dynamics, and emotion sequence in a conversation using Transformer encoders and stacked GRUs. Our evaluation yields state-of-the-art performance against five baselines adopted for our task. A detailed diagnosis of the competing models further illustrates the advantages and pitfalls of the neural architecture.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Emotion Flip Reasoning in Multiparty Conversations
In a conversational dialogue, speakers may have different emotional states and their dynamics play an important role in understanding dialogue's emotional discourse. However, simply detecting emotions is not sufficient t…
IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddings
This paper presents our approach for the SemEval-2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversations. For the Emotion Recognition in Conversations (ERC) task, we utilize a masked-memory network along …
Emotion RecognitionDiscovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer
Efficient discovery of a speaker's emotional states in a multi-party conversation is significant to design human-like conversational agents. During a conversation, the cognitive state of a speaker often alters due to cer…
Emotion RecognitionSemEval 2024 -- Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF)
We present SemEval-2024 Task 10, a shared task centred on identifying emotions and finding the rationale behind their flips within monolingual English and Hindi-English code-mixed dialogues. This task comprises three dis…
Emotion RecognitionEmotion Recognition in ConversationA Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations
Multimodal Emotion Recognition in Multiparty Conversations (MERMC) has recently attracted considerable attention. Due to the complexity of visual scenes in multi-party conversations, most previous MERMC studies mainly fo…
Emotion RecognitionEmotion Recognition in ConversationFacial Expression Recognition (FER)Multimodal Emotion Recognition+1