Relate auditory speech to EEG by shallow-deep attention-based network
Electroencephalography (EEG) plays a vital role in detecting how brain responses to different stimulus. In this paper, we propose a novel Shallow-Deep Attention-based Network (SDANet) to classify the correct auditory stimulus evoking the EEG signal. It adopts the Attention-based Correlation Module (ACM) to discover the connection between auditory speech and EEG from global aspect, and the Shallow-Deep Similarity Classification Module (SDSCM) to decide the classification result via the embeddings learned from the shallow and deep layers. Moreover, various training strategies and data augmentation are used to boost the model robustness. Experiments are conducted on the dataset provided by Auditory EEG challenge (ICASSP Signal Processing Grand Challenge 2023). Results show that the proposed model has a significant gain over the baseline on the match-mismatch track.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDeep AttentionEEGElectroencephalogram (EEG)Similar Papers 제목 키워드 기반
Study of cognitive component of auditory attention to natural speech events
Event-related potentials (ERP) have been used to address a wide range of research questions in neuroscience and cognitive psychology including selective auditory attention. The recent progress in auditory attention decod…
EEGElectroencephalogram (EEG)ERPSingle-word Auditory Attention Decoding Using Deep Learning Model
Identifying auditory attention by comparing auditory stimuli and corresponding brain responses, is known as auditory attention decoding (AAD). The majority of AAD algorithms utilize the so-called envelope entrainment mec…
Deep LearningEEGCorticomorphic Hybrid CNN-SNN Architecture for EEG-based Low-footprint Low-latency Auditory Attention Detection
In a multi-speaker "cocktail party" scenario, a listener can selectively attend to a speaker of interest. Studies into the human auditory attention network demonstrate cortical entrainment to speech envelopes resulting i…
Edge-computingEEGDGSD: Dynamical Graph Self-Distillation for EEG-Based Auditory Spatial Attention Detection
Auditory Attention Detection (AAD) aims to detect target speaker from brain signals in a multi-speaker environment. Although EEG-based AAD methods have shown promising results in recent years, current approaches primaril…
EEGDecoding Envelope and Frequency-Following EEG Responses to Continuous Speech Using Deep Neural Networks
The electroencephalogram (EEG) offers a non-invasive means by which a listener's auditory system may be monitored during continuous speech perception. Reliable auditory-EEG decoders could facilitate the objective diagnos…
EEGElectroencephalogram (EEG)Robust classification