paper-with-me

홈 › Papers

Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement

2023-09-18 · Shanglin Lei, XiaoPing Wang, Guanting Dong, Jiang Li, Yingjian Liu

Emotion Recognition in Conversation (ERC) has attracted widespread attention in the natural language processing field due to its enormous potential for practical applications. Existing ERC methods face challenges in achieving generalization to diverse scenarios due to insufficient modeling of context, ambiguous capture of dialogue relationships and overfitting in speaker modeling. In this work, we present a Hybrid Continuous Attributive Network (HCAN) to address these issues in the perspective of emotional continuation and emotional attribution. Specifically, HCAN adopts a hybrid recurrent and attention-based module to model global emotion continuity. Then a novel Emotional Attribution Encoding (EAE) is proposed to model intra- and inter-emotional attribution for each utterance. Moreover, aiming to enhance the robustness of the model in speaker modeling and improve its performance in different scenarios, A comprehensive loss function emotional cognitive loss $\mathcal{L}_{\rm EC}$ is proposed to alleviate emotional drift and overcome the overfitting of the model to speaker modeling. Our model achieves state-of-the-art performance on three datasets, demonstrating the superiority of our work. Another extensive comparative experiments and ablation studies on three benchmarks are conducted to provided evidence to support the efficacy of each module. Further exploration of generalization ability experiments shows the plug-and-play nature of the EAE module in our method.

📄 PDF Abstract BibTeX arXiv:2309.09799

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementEmotion RecognitionEmotion Recognition in Conversation

Similar Papers 제목 키워드 기반

A dataset of continuous affect annotations and physiological signals for emotion analysis

2018-12-06 · Karan Sharma, Claudio Castellini, Egon L. van den Broek, Alin Albu-Schaeffer 외

From a computational viewpoint, emotions continue to be intriguingly hard to understand. In research, direct, real-time inspection in realistic settings is not possible. Discrete, indirect, post-hoc recordings are theref…

Emotion Recognition

Model architectures to extrapolate emotional expressions in DNN-based text-to-speech

2021-02-20 · Katsuki Inoue, Sunao Hara, Masanobu Abe, Nobukatsu Hojo 외

This paper proposes architectures that facilitate the extrapolation of emotional expressions in deep neural network (DNN)-based text-to-speech (TTS). In this study, the meaning of "extrapolate emotional expressions" is t…

text-to-speechText to Speech

Converting Anyone's Emotion: Towards Speaker-Independent Emotional Voice Conversion

2020-05-13 · Kun Zhou, Berrak Sisman, Mingyang Zhang, Haizhou Li

Emotional voice conversion aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. The prior studies on emotional voice conversion are mostly carried …

DecoderVoice Conversion

Proactive Emotion Tracker: AI-Driven Continuous Mood and Emotion Monitoring

2024-01-24 · Mohammad Asif, Sudhakar Mishra, Ankush Sonker, Sanidhya Gupta 외

This research project aims to tackle the growing mental health challenges in today's digital age. It employs a modified pre-trained BERT model to detect depressive text within social media and users' web browsing data, a…

EEGPrognosis

Semi-supervised learning for continuous emotional intensity controllable speech synthesis with disentangled representations

2022-11-11 · Yoori Oh, Juheon Lee, Yoseob Han, Kyogu Lee

Recent text-to-speech models have reached the level of generating natural speech similar to what humans say. But there still have limitations in terms of expressiveness. The existing emotional speech synthesis models hav…

Emotional Speech SynthesisSpeech Synthesistext-to-speechText to Speech