paper-with-me

Papers

SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations

2023-10-25 · Tao Shi, Xiao Liang, Yaoyuan Liang, Xinyi Tong, Shao-Lun Huang

Emotion recognition in conversations (ERC) is a rapidly evolving task within the natural language processing community, which aims to detect the emotions expressed by speakers during a conversation. Recently, a growing number of ERC methods have focused on leveraging supervised contrastive learning (SCL) to enhance the robustness and generalizability of learned features. However, current SCL-based approaches in ERC are impeded by the constraint of large batch sizes and the lack of compatibility with most existing ERC models. To address these challenges, we propose an efficient and model-agnostic SCL framework named Supervised Sample-Label Contrastive Learning with Soft-HGR Maximal Correlation (SSLCL), which eliminates the need for a large batch size and can be seamlessly integrated with existing ERC models without introducing any model-specific assumptions. Specifically, we introduce a novel perspective on utilizing label representations by projecting discrete labels into dense embeddings through a shallow multilayer perceptron, and formulate the training objective to maximize the similarity between sample features and their corresponding ground-truth label embeddings, while minimizing the similarity between sample features and label embeddings of disparate classes. Moreover, we innovatively adopt the Soft-HGR maximal correlation as a measure of similarity between sample features and label embeddings, leading to significant performance improvements over conventional similarity measures. Additionally, multimodal cues of utterances are effectively leveraged by SSLCL as data augmentations to boost model performances. Extensive experiments on two ERC benchmark datasets, IEMOCAP and MELD, demonstrate the compatibility and superiority of our proposed SSLCL framework compared to existing state-of-the-art SCL methods. Our code is available at \url{https://github.com/TaoShi1998/SSLCL}.

📄 PDF Abstract BibTeX arXiv:2310.16676

Code (1)

taoshi1998/sslcl 공식 구현 pytorch

Tasks

Contrastive LearningEmotion Recognition

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

A Supervised Information Enhanced Multi-Granularity Contrastive Learning Framework for EEG Based Emotion Recognition

2024-05-12 · Xiang Li, Jian Song, Zhigang Zhao, Chunxiao Wang 외

This study introduces a novel Supervised Info-enhanced Contrastive Learning framework for EEG based Emotion Recognition (SICLEER). SI-CLEER employs multi-granularity contrastive learning to create robust EEG contextual r…

Contrastive LearningEEGEmotion Recognition

VAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injection

2025-05-05 · Hao Cheng, Zhiwei Zhao, Yichao He, Zhenzhen Hu 외

Audiovisual emotion recognition (AVER) aims to infer human emotions from nonverbal visual-audio (VA) cues, offering modality-complementary and language-agnostic advantages. However, AVER remains challenging due to the in…

Contrastive LearningDynamic Facial Expression RecognitionEmotion RecognitionRepresentation Learning+2

Large Language Models Meet Contrastive Learning: Zero-Shot Emotion Recognition Across Languages

2025-03-25 · Heqing Zou, Fengmao Lv, Desheng Zheng, Eng Siong Chng 외

Multilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages. However, variability in voice characteristics and linguistic diversity poses sig…

Contrastive LearningDiversityEmotion RecognitionSpeech Emotion Recognition

Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

2023-08-13 · Weishan Ye, Zhiguo Zhang, Fei Teng, Min Zhang 외

Electroencephalography (EEG) is an objective tool for emotion recognition with promising applications. However, the scarcity of labeled data remains a major challenge in this field, limiting the widespread use of EEG-bas…

Contrastive LearningDomain AdaptationEEGEmotion Recognition

EEG-based Emotion Recognition via Efficient Convolutional Neural Network and Contrastive Learning

2022-09-02 · IEEE Sensors Journal 2022 9 · Chang Li, Xuejuan Lin, Yu Liu, Rencheng Song 외

Convolutional neural networks (CNNs) have achieved better performance than traditional algorithms in electroencephalogram (EEG)-based emotion recognition tasks in the recent years. However, as the number of convolution l…

Contrastive LearningEEGElectroencephalogram (EEG)Emotion Recognition