Speech Synthesis using EEG
In this paper we demonstrate speech synthesis using different electroencephalography (EEG) feature sets recently introduced in [1]. We make use of a recurrent neural network (RNN) regression model to predict acoustic features directly from EEG features. We demonstrate our results using EEG features recorded in parallel with spoken speech as well as using EEG recorded in parallel with listening utterances. We provide EEG based speech synthesis results for four subjects in this paper and our results demonstrate the feasibility of synthesizing speech directly from EEG features.
Code (0)
등록된 구현이 없습니다.
Tasks
EEGElectroencephalogram (EEG)regressionSpeech SynthesisSimilar Papers 제목 키워드 기반
Simple and Effective Unsupervised Speech Synthesis
We introduce the first unsupervised speech synthesis system based on a simple, yet effective recipe. The framework leverages recent work in unsupervised speech recognition as well as existing neural-based speech synthesi…
speech-recognitionSpeech RecognitionSpeech SynthesisUnsupervised Speech RecognitionNeural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks
Brain-to-speech technology represents a fusion of interdisciplinary applications encompassing fields of artificial intelligence, brain-computer interfaces, and speech synthesis. Neural representation learning based inten…
Representation LearningSpeech SynthesisHierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis
Large language models (LLM)-based speech synthesis has been widely adopted in zero-shot speech synthesis. However, they require a large-scale data and possess the same limitations as previous autoregressive speech models…
Speech SynthesisSuper-Resolutiontext-to-speechText to Speech+2Byakto Speech: Real-time long speech synthesis with convolutional neural network: Transfer learning from English to Bangla
Speech synthesis is one of the challenging tasks to automate by deep learning, also being a low-resource language there are very few attempts at Bangla speech synthesis. Most of the existing works can't work with anythin…
Deep Learningspeech-recognitionSpeech RecognitionSpeech Synthesis+1Requirements and Motivations of Low-Resource Speech Synthesis for Language Revitalization
This paper describes the motivation and development of speech synthesis systems for the purposes of language revitalization. By building speech synthesis systems for three Indigenous languages spoken in Canada, Kanien’ké…
Speech Synthesis