Transfer Learning for Covert Speech Classification Using EEG Hilbert Envelope and Temporal Fine Structure
Brain-Computer Interfaces (BCIs) can decode imagined speech from neural activity. However, these systems typically require extensive training sessions where participants imaginedly repeat words, leading to mental fatigue and difficulties identifying the onset of words, especially when imagining sequences of words. This paper addresses these challenges by transferring a classifier trained in overt speech data to covert speech classification. We used electroencephalogram (EEG) features derived from the Hilbert envelope and temporal fine structure, and used them to train a bidirectional long-short-term memory (BiLSTM) model for classification. Our method reduces the burden of extensive training and achieves state-of-the-art classification accuracy: 86.44% for overt speech and 79.82% for covert speech using the overt speech classifier.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationEEGElectroencephalogram (EEG)Transfer LearningSimilar Papers 제목 키워드 기반
Dereverberation of Autoregressive Envelopes for Far-field Speech Recognition
The task of speech recognition in far-field environments is adversely affected by the reverberant artifacts that elicit as the temporal smearing of the sub-band envelopes. In this paper, we develop a neural model for spe…
Speech Dereverberationspeech-recognitionSpeech RecognitionQuartered Chirp Spectral Envelope for Whispered vs Normal Speech Classification
Whispered speech as an acceptable form of human-computer interaction is gaining traction. Systems that address multiple modes of speech require a robust front-end speech classifier. Performance of whispered vs normal spe…
Radically Old Way of Computing Spectra: Applications in End-to-End ASR
We propose a technique to compute spectrograms using Frequency Domain Linear Prediction (FDLP) that uses all-pole models to fit the squared Hilbert envelope of speech in different frequency sub-bands. The spectrogram of …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech RecognitionRevisiting R: Statistical Envelope Analysis for Lightweight RF Modulation Classification
Modulation classification plays a crucial role in wireless communication systems, enabling applications such as cognitive radio, spectrum monitoring, and electronic warfare. Conventional techniques often involve deep lea…
ClassificationWasserstein Gradient Flows for Moreau Envelopes of f-Divergences in Reproducing Kernel Hilbert Spaces
Commonly used $f$-divergences of measures, e.g., the Kullback-Leibler divergence, are subject to limitations regarding the support of the involved measures. A remedy is regularizing the $f$-divergence by a squared maximu…