paper-with-me

홈 › Papers

COIN: Conversational Interactive Networks for Emotion Recognition in Conversation

2021-06-01 · NAACL (maiworkshop) 2021 6 · Haidong Zhang, Yekun Chai

Emotion recognition in conversation has received considerable attention recently because of its practical industrial applications. Existing methods tend to overlook the immediate mutual interaction between different speakers in the speaker-utterance level, or apply single speaker-agnostic RNN for utterances from different speakers. We propose COIN, a conversational interactive model to mitigate this problem by applying state mutual interaction within history contexts. In addition, we introduce a stacked global interaction module to capture the contextual and inter-dependency representation in a hierarchical manner. To improve the robustness and generalization during training, we generate adversarial examples by applying the minor perturbations on multimodal feature inputs, unveiling the benefits of adversarial examples for emotion detection. The proposed model empirically achieves the current state-of-the-art results on the IEMOCAP benchmark dataset.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion RecognitionEmotion Recognition in Conversation

Similar Papers 제목 키워드 기반

ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection

2018-10-01 · EMNLP 2018 10 · Devamanyu Hazarika, Soujanya Poria, Rada Mihalcea, Erik Cambria 외

Emotion recognition in conversations is crucial for building empathetic machines. Present works in this domain do not explicitly consider the inter-personal influences that thrive in the emotional dynamics of dialogues. …

Emotion RecognitionEmotion Recognition in ConversationGeneral ClassificationMultimodal Emotion Recognition+1

A Contextualized Real-Time Multimodal Emotion Recognition for Conversational Agents using Graph Convolutional Networks in Reinforcement Learning

2023-10-24 · Fathima Abdul Rahman, Guang Lu

Owing to the recent developments in Generative Artificial Intelligence (GenAI) and Large Language Models (LLM), conversational agents are becoming increasingly popular and accepted. They provide a human touch by interact…

Emotion ClassificationEmotion RecognitionMultimodal Emotion Recognitionreinforcement-learning+2

JELLY: Joint Emotion Recognition and Context Reasoning with LLMs for Conversational Speech Synthesis

2025-01-09 · Jun-Hyeok Cha, Seung-bin Kim, Hyung-Seok Oh, Seong-Whan Lee

Recently, there has been a growing demand for conversational speech synthesis (CSS) that generates more natural speech by considering the conversational context. To address this, we introduce JELLY, a novel CSS framework…

Emotion RecognitionLanguage ModelingLanguage ModellingLarge Language Model+1

Evaluating multimodal emotion recognition in proactive conversational agents: A user study

2026-04-06 · Adnana Dragut, Raquel Lacuesta, F. Xavier Gaya-Morey, Jose M. Buades-Rubio arxiv

This article presents a multimodal emotion recognition module integrated into a proactive Socially Interactive Agent (SIA) powered by generative artificial intelligence. The system evaluates real-time affective states th…

Multimodal Emotion Recognition

Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations

2023-04-17 · Patrícia Pereira, Helena Moniz, Isabel Dias, Joao Paulo Carvalho

Emotion Recognition in Conversations (ERC) has been gaining increasing importance as conversational agents become more and more common. Recognizing emotions is key for effective communication, being a crucial component i…

ClassificationEmotion RecognitionEmotion Recognition in Conversation