paper-with-me

Papers

Cluster-Level Contrastive Learning for Emotion Recognition in Conversations

2023-02-07 · Kailai Yang, Tianlin Zhang, Hassan Alhuzali, Sophia Ananiadou

A key challenge for Emotion Recognition in Conversations (ERC) is to distinguish semantically similar emotions. Some works utilise Supervised Contrastive Learning (SCL) which uses categorical emotion labels as supervision signals and contrasts in high-dimensional semantic space. However, categorical labels fail to provide quantitative information between emotions. ERC is also not equally dependent on all embedded features in the semantic space, which makes the high-dimensional SCL inefficient. To address these issues, we propose a novel low-dimensional Supervised Cluster-level Contrastive Learning (SCCL) method, which first reduces the high-dimensional SCL space to a three-dimensional affect representation space Valence-Arousal-Dominance (VAD), then performs cluster-level contrastive learning to incorporate measurable emotion prototypes. To help modelling the dialogue and enriching the context, we leverage the pre-trained knowledge adapters to infuse linguistic and factual knowledge. Experiments show that our method achieves new state-of-the-art results with 69.81% on IEMOCAP, 65.7% on MELD, and 62.51% on DailyDialog datasets. The analysis also proves that the VAD space is not only suitable for ERC but also interpretable, with VAD prototypes enhancing its performance and stabilising the training of SCCL. In addition, the pre-trained knowledge adapters benefit the performance of the utterance encoder and SCCL. Our code is available at: https://github.com/SteveKGYang/SCCL

📄 PDF Abstract BibTeX arXiv:2302.03508

Code (1)

stevekgyang/sccl 공식 구현 pytorch

Tasks

Contrastive LearningEmotion Recognition

Methods 이 논문이 사용한 방법론

fail 설명 없음
SCCL SCCL, or Supporting Clustering with Contrastive Learning, is a framework to leverage contrastive learning to promote better separation in unsupervised clustering. It…
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations

2023-07-01 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2023 7 · Wenjie Zheng, Jianfei Yu, Rui Xia, Shijin Wang

Multimodal Emotion Recognition in Multiparty Conversations (MERMC) has recently attracted considerable attention. Due to the complexity of visual scenes in multi-party conversations, most previous MERMC studies mainly fo…

Emotion RecognitionEmotion Recognition in ConversationFacial Expression Recognition (FER)Multimodal Emotion Recognition+1

Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations

2023-06-02 · Dou Hu, Yinan Bao, Lingwei Wei, Wei Zhou 외

Extracting generalized and robust representations is a major challenge in emotion recognition in conversations (ERC). To address this, we propose a supervised adversarial contrastive learning (SACL) framework for learnin…

Contrastive LearningEmotion RecognitionEmotion Recognition in Conversation

GatedxLSTM: A Multimodal Affective Computing Approach for Emotion Recognition in Conversations

2025-03-26 · Yupei Li, Qiyang Sun, Sunil Munthumoduku Krishna Murthy, Emran Alturki 외

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an in…

cross-modal alignmentEmotion ClassificationEmotion RecognitionEmotion Recognition in Conversation+1

AdCOFE: Advanced Contextual Feature Extraction in Conversations for emotion classification

2021-04-09 · Vaibhav Bhat, Anita Yadav, Sonal Yadav, Dhivya Chandrasekran 외

Emotion recognition in conversations is an important step in various virtual chat bots which require opinion-based feedback, like in social media threads, online support and many more applications. Current Emotion recogn…

ClassificationEmotion ClassificationEmotion RecognitionGeneral Classification+2

Revealing Emotional Clusters in Speaker Embeddings: A Contrastive Learning Strategy for Speech Emotion Recognition

2024-01-19 · Ismail Rasim Ulgen, Zongyang Du, Carlos Busso, Berrak Sisman

Speaker embeddings carry valuable emotion-related information, which makes them a promising resource for enhancing speech emotion recognition (SER), especially with limited labeled data. Traditionally, it has been assume…

Contrastive LearningEmotion RecognitionSpeech Emotion Recognition