Cross-domain EEG-based Emotion Recognition with Contrastive Learning
Electroencephalogram (EEG)-based emotion recognition is vital for affective computing but faces challenges in feature utilization and cross-domain generalization. This work introduces EmotionCLIP, which reformulates recognition as an EEG-text matching task within the CLIP framework. A tailored backbone, SST-LegoViT, captures spatial, spectral, and temporal features using multi-scale convolution and Transformer modules. Experiments on SEED and SEED-IV datasets show superior cross-subject accuracies of 88.69\% and 73.50\%, and cross-time accuracies of 88.46\% and 77.54\%, outperforming existing models. Results demonstrate the effectiveness of multimodal contrastive learning for robust EEG emotion recognition. The code is available at https://github.com/Departure2021/EmotionCLIP.
Code (0)
등록된 구현이 없습니다.
Tasks
EEG Emotion RecognitionDomain GeneralizationContrastive LearningSimilar Papers 제목 키워드 기반
Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition
Electroencephalography (EEG) is an objective tool for emotion recognition with promising applications. However, the scarcity of labeled data remains a major challenge in this field, limiting the widespread use of EEG-bas…
Contrastive LearningDomain AdaptationEEGEmotion RecognitionMulti-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation
Electroencephalography (EEG) provides reliable indications of human cognition and mental states. Accurate emotion recognition from EEG remains challenging due to signal variations among individuals and across measurement…
Domain AdaptationEEGEEG Emotion RecognitionEmotion RecognitionMouth Articulation-Based Anchoring for Improved Cross-Corpus Speech Emotion Recognition
Cross-corpus speech emotion recognition (SER) plays a vital role in numerous practical applications. Traditional approaches to cross-corpus emotion transfer often concentrate on adapting acoustic features to align with d…
Cross-corpusEmotion RecognitionSpeech Emotion RecognitionTransfer LearningMCN-CL: Multimodal Cross-Attention Network and Contrastive Learning for Multimodal Emotion Recognition
Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: u…
Multimodal Emotion RecognitionContrastive LearningContrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
EEG signals have been reported to be informative and reliable for emotion recognition in recent years. However, the inter-subject variability of emotion-related EEG signals still poses a great challenge for the practical…
Contrastive LearningEEGElectroencephalogram (EEG)Emotion Classification+3