Continuous Silent Speech Recognition using EEG
In this paper we explore continuous silent speech recognition using electroencephalography (EEG) signals. We implemented a connectionist temporal classification (CTC) automatic speech recognition (ASR) model to translate EEG signals recorded in parallel while subjects were reading English sentences in their mind without producing any voice to text. Our results demonstrate the feasibility of using EEG signals for performing continuous silent speech recognition. We demonstrate our results for a limited English vocabulary consisting of 30 unique sentences.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)EEGElectroencephalogram (EEG)General ClassificationSilent Speech Recognitionspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Determining an Optimal Set of Flesh Points on Tongue, Lips, and Jaw for Continuous Silent Speech Recognition
Silent versus modal multi-speaker speech recognition from ultrasound and video
We investigate multi-speaker speech recognition from ultrasound images of the tongue and video images of the lips. We train our systems on imaging data from modal speech, and evaluate on matched test sets of two speaking…
Silent Speech Recognitionspeech-recognitionSpeech RecognitionVisual-Only Recognition of Normal, Whispered and Silent Speech
Silent speech interfaces have been recently proposed as a way to enable communication when the acoustic signal is not available. This introduces the need to build visual speech recognition systems for silent and whispere…
Silent Speech Recognitionspeech-recognitionSpeech RecognitionVisual Speech RecognitionImproving the Gap in Visual Speech Recognition Between Normal and Silent Speech Based on Metric Learning
This paper presents a novel metric learning approach to address the performance gap between normal and silent speech in visual speech recognition (VSR). The difference in lip movements between the two poses a challenge f…
Metric Learningspeech-recognitionSpeech RecognitionVisual Speech RecognitionA Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognition
Silent Speech Interfaces (SSIs) offer a noninvasive alternative to brain-computer interfaces for soundless verbal communication. We introduce Multimodal Orofacial Neural Audio (MONA), a system that leverages cross-modal …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)cross-modal alignmentLanguage Modelling+4