4D Attention-based Neural Network for EEG Emotion Recognition
Electroencephalograph (EEG) emotion recognition is a significant task in the brain-computer interface field. Although many deep learning methods are proposed recently, it is still challenging to make full use of the information contained in different domains of EEG signals. In this paper, we present a novel method, called four-dimensional attention-based neural network (4D-aNN) for EEG emotion recognition. First, raw EEG signals are transformed into 4D spatial-spectral-temporal representations. Then, the proposed 4D-aNN adopts spectral and spatial attention mechanisms to adaptively assign the weights of different brain regions and frequency bands, and a convolutional neural network (CNN) is utilized to deal with the spectral and spatial information of the 4D representations. Moreover, a temporal attention mechanism is integrated into a bidirectional Long Short-Term Memory (LSTM) to explore temporal dependencies of the 4D representations. Our model achieves state-of-the-art performance on the SEED dataset under intra-subject splitting. The experimental results have shown the effectiveness of the attention mechanisms in different domains for EEG emotion recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Brain Computer InterfaceEEGEEG Emotion RecognitionElectroencephalogram (EEG)Emotion RecognitionSimilar Papers 제목 키워드 기반
Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition
Modern emotion recognition systems are trained to recognize only a small set of emotions, and hence fail to capture the broad spectrum of emotions people experience and express in daily life. In order to engage in more e…
Emotion RecognitionConvolutional Attention Networks for Multimodal Emotion Recognition from Speech and Text Data
Emotion recognition has become a popular topic of interest, especially in the field of human computer interaction. Previous works involve unimodal analysis of emotion, while recent efforts focus on multi-modal emotion re…
Emotion RecognitionMultimodal Emotion RecognitionAttention-based Region of Interest (ROI) Detection for Speech Emotion Recognition
Automatic emotion recognition for real-life appli-cations is a challenging task. Human emotion expressions aresubtle, and can be conveyed by a combination of several emo-tions. In most existing emotion recognition studie…
Emotion RecognitionMulti-class ClassificationSpeech Emotion RecognitionKnowledge-aware Bayesian Co-attention for Multimodal Emotion Recognition
Multimodal emotion recognition is a challenging research area that aims to fuse different modalities to predict human emotion. However, most existing models that are based on attention mechanisms have difficulty in learn…
Emotion RecognitionMultimodal Emotion RecognitionMulti-stream Attention-based BLSTM with Feature Segmentation for Speech Emotion Recognition
This paper proposes a speech emotion recognition technique that considers the suprasegmental characteristics and temporal change of individual speech parameters. In recent years, speech emotion recognition using Bidir…
Data AugmentationEmotional Speech SynthesisEmotion RecognitionSpeech Emotion Recognition+1