Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks
One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein, we propose a novel approach for learning such representations from multi-channel EEG time-series, and demonstrate its advantages in the context of mental load classification task. First, we transform EEG activities into a sequence of topology-preserving multi-spectral images, as opposed to standard EEG analysis techniques that ignore such spatial information. Next, we train a deep recurrent-convolutional network inspired by state-of-the-art video classification to learn robust representations from the sequence of images. The proposed approach is designed to preserve the spatial, spectral, and temporal structure of EEG which leads to finding features that are less sensitive to variations and distortions within each dimension. Empirical evaluation on the cognitive load classification task demonstrated significant improvements in classification accuracy over current state-of-the-art approaches in this field.
Code (11)
Tasks
EEGElectroencephalogram (EEG)General ClassificationTime SeriesTime Series AnalysisVideo ClassificationSimilar Papers 제목 키워드 기반
A Study on Spoken Language Identification using Deep Neural Networks
In this paper, we investigate a previously proposed algorithm for spoken language identification based on convolutional neural networks and convolutional recurrent neural networks. We improve the algorithm by modifying t…
Language IdentificationSpoken language identificationRanking Convolutional Recurrent Neural Networks for Purchase Stage Identification on Imbalanced Twitter Data
Users often use social media to share their interest in products. We propose to identify purchase stages from Twitter data following the AIDA model (Awareness, Interest, Desire, Action). In particular, we define the task…
Word EmbeddingsConvolutional Gated Recurrent Units for Medical Relation Classification
Convolutional neural network (CNN) and recurrent neural network (RNN) models have become the mainstream methods for relation classification. We propose a unified architecture, which exploits the advantages of CNN and RNN…
ClassificationGeneral ClassificationRelationRelation ClassificationVideo Description using Bidirectional Recurrent Neural Networks
Although traditionally used in the machine translation field, the encoder-decoder framework has been recently applied for the generation of video and image descriptions. The combination of Convolutional and Recurrent Neu…
DecoderText GenerationTranslationVideo Captioning+1Contextual Recurrent Convolutional Model for Robust Visual Learning
Feedforward convolutional neural network has achieved a great success in many computer vision tasks. While it validly imitates the hierarchical structure of biological visual system, it still lacks one essential architec…
Fine-Grained Image ClassificationGeneral Classificationimage-classificationImage Classification+2