Relating EEG recordings to speech using envelope tracking and the speech-FFR
During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is challenging due to the low signal-to-noise ratios of EEG signals. We report on an approach developed for the ICASSP 2023 'Auditory EEG Decoding' Signal Processing Grand Challenge. A simple ensembling method is shown to considerably improve upon the baseline decoder performance. Even higher classification rates are achieved by jointly decoding the speech-evoked frequency-following response and responses to the temporal envelope of speech, as well as by fine-tuning the decoders to individual subjects. Our results could have applications in the diagnosis of hearing disorders or in cognitively steered hearing aids.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderEEGEeg DecodingElectroencephalogram (EEG)Similar Papers 제목 키워드 기반
Detecting gamma-band responses to the speech envelope for the ICASSP 2024 Auditory EEG Decoding Signal Processing Grand Challenge
The 2024 ICASSP Auditory EEG Signal Processing Grand Challenge concerns the decoding of electroencephalography (EEG) measurements taken from participants who listened to speech material. This work details our solution to…
DecoderEEGEeg DecodingRelating the fundamental frequency of speech with EEG using a dilated convolutional network
To investigate how speech is processed in the brain, we can model the relation between features of a natural speech signal and the corresponding recorded electroencephalogram (EEG). Usually, linear models are used in reg…
EEGElectroencephalogram (EEG)EEG-informed attended speaker extraction from recorded speech mixtures with application in neuro-steered hearing prostheses
OBJECTIVE: We aim to extract and denoise the attended speaker in a noisy, two-speaker acoustic scenario, relying on microphone array recordings from a binaural hearing aid, which are complemented with electroencephalogra…
DenoisingEEGElectroencephalogram (EEG)Speech SeparationDetecting post-stroke aphasia using EEG-based neural envelope tracking of natural speech
[Objective]. After a stroke, one-third of patients suffer from aphasia, a language disorder that impairs communication ability. The standard behavioral tests used to diagnose aphasia are time-consuming and have low ecolo…
DiagnosticEEGElectroencephalogram (EEG)Complex Mapping between Neural Response Frequency and Linguistic Units in Natural Speech
When listening to connected speech, human brain can extract multiple levels of linguistic units, such as syllables, words, and sentences. It has been hypothesized that the time scale of cortical activity encoding each li…