Temporal Aware Mixed Attention-based Convolution and Transformer Network (MACTN) for EEG Emotion Recognition
Emotion recognition plays a crucial role in human-computer interaction, and electroencephalography (EEG) is advantageous for reflecting human emotional states. In this study, we propose MACTN, a hierarchical hybrid model for jointly modeling local and global temporal information. The model is inspired by neuroscience research on the temporal dynamics of emotions. MACTN extracts local emotional features through a convolutional neural network (CNN) and integrates sparse global emotional features through a transformer. Moreover, we employ channel attention mechanisms to identify the most task-relevant channels. Through extensive experimentation on two publicly available datasets, namely THU-EP and DEAP, our proposed method, MACTN, consistently achieves superior classification accuracy and F1 scores compared to other existing methods in most experimental settings. Furthermore, ablation studies have shown that the integration of both self-attention mechanisms and channel attention mechanisms leads to improved classification performance. Finally, an earlier version of this method, which shares the same ideas, won the Emotional BCI Competition's final championship in the 2022 World Robot Contest.
Code (0)
등록된 구현이 없습니다.
Tasks
EEGEEG Emotion RecognitionEmotion RecognitionSimilar Papers 제목 키워드 기반
TwinS: Revisiting Non-Stationarity in Multivariate Time Series Forecasting
Recently, multivariate time series forecasting tasks have garnered increasing attention due to their significant practical applications, leading to the emergence of various deep forecasting models. However, real-world ti…
Multivariate Time Series ForecastingTime SeriesTime Series ForecastingFrequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformer
Recently, transformers have demonstrated great potential for modeling long-term dependencies from skeleton sequences and thereby gained ever-increasing attention in skeleton action recognition. However, the existing tran…
Action RecognitionSkeleton Based Action RecognitionAttention-aware Social Graph Transformer Networks for Stochastic Trajectory Prediction
Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improv…
Autonomous Drivingmotion predictionPredictionTrajectory PredictionEmMixformer: Mix transformer for eye movement recognition
Eye movement (EM) is a new highly secure biometric behavioral modality that has received increasing attention in recent years. Although deep neural networks, such as convolutional neural network (CNN), have recently achi…
PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution
Since the superiority of Transformer in learning long-term dependency, the sign language Transformer model achieves remarkable progress in Sign Language Recognition (SLR) and Translation (SLT). However, there are several…
DecoderPositionSign Language RecognitionTranslation