COIN: Conversational Interactive Networks for Emotion Recognition in Conversation
Emotion recognition in conversation has received considerable attention recently because of its practical industrial applications. Existing methods tend to overlook the immediate mutual interaction between different speakers in the speaker-utterance level, or apply single speaker-agnostic RNN for utterances from different speakers. We propose COIN, a conversational interactive model to mitigate this problem by applying state mutual interaction within history contexts. In addition, we introduce a stacked global interaction module to capture the contextual and inter-dependency representation in a hierarchical manner. To improve the robustness and generalization during training, we generate adversarial examples by applying the minor perturbations on multimodal feature inputs, unveiling the benefits of adversarial examples for emotion detection. The proposed model empirically achieves the current state-of-the-art results on the IEMOCAP benchmark dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion RecognitionEmotion Recognition in ConversationSimilar Papers 제목 키워드 기반
ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection
Emotion recognition in conversations is crucial for building empathetic machines. Present works in this domain do not explicitly consider the inter-personal influences that thrive in the emotional dynamics of dialogues. …
Emotion RecognitionEmotion Recognition in ConversationGeneral ClassificationMultimodal Emotion Recognition+1A Contextualized Real-Time Multimodal Emotion Recognition for Conversational Agents using Graph Convolutional Networks in Reinforcement Learning
Owing to the recent developments in Generative Artificial Intelligence (GenAI) and Large Language Models (LLM), conversational agents are becoming increasingly popular and accepted. They provide a human touch by interact…
Emotion ClassificationEmotion RecognitionMultimodal Emotion Recognitionreinforcement-learning+2JELLY: Joint Emotion Recognition and Context Reasoning with LLMs for Conversational Speech Synthesis
Recently, there has been a growing demand for conversational speech synthesis (CSS) that generates more natural speech by considering the conversational context. To address this, we introduce JELLY, a novel CSS framework…
Emotion RecognitionLanguage ModelingLanguage ModellingLarge Language Model+1Evaluating multimodal emotion recognition in proactive conversational agents: A user study
This article presents a multimodal emotion recognition module integrated into a proactive Socially Interactive Agent (SIA) powered by generative artificial intelligence. The system evaluates real-time affective states th…
Multimodal Emotion RecognitionContext-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations
Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component i…
ClassificationEmotion RecognitionEmotion Recognition in Conversation