Generating EEG features from Acoustic features
In this paper we demonstrate predicting electroencephalograpgy (EEG) features from acoustic features using recurrent neural network (RNN) based regression model and generative adversarial network (GAN). We predict various types of EEG features from acoustic features. We compare our results with the previously studied problem on speech synthesis using EEG and our results demonstrate that EEG features can be generated from acoustic features with lower root mean square error (RMSE), normalized RMSE values compared to generating acoustic features from EEG features (ie: speech synthesis using EEG) when tested using the same data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
EEGElectroencephalogram (EEG)Generative Adversarial NetworkregressionSpeech SynthesisSimilar Papers 제목 키워드 기반
Ctrl-P: Temporal Control of Prosodic Variation for Speech Synthesis
Text does not fully specify the spoken form, so text-to-speech models must be able to learn from speech data that vary in ways not explained by the corresponding text. One way to reduce the amount of unexplained variatio…
Speech Synthesistext-to-speechText to SpeechRethinking Speech Recognition with A Multimodal Perspective via Acoustic and Semantic Cooperative Decoding
Attention-based encoder-decoder (AED) models have shown impressive performance in ASR. However, most existing AED methods neglect to simultaneously leverage both acoustic and semantic features in decoder, which is crucia…
Decoderspeech-recognitionSpeech RecognitionMAGIC: Map-Guided Few-Shot Audio-Visual Acoustics Modeling
Few-shot audio-visual acoustics modeling seeks to synthesize the room impulse response in arbitrary locations with few-shot observations. To sufficiently exploit the provided few-shot data for accurate acoustic modeling,…
DecoderLearning Frame Similarity using Siamese networks for Audio-to-Score Alignment
Audio-to-score alignment aims at generating an accurate mapping between a performance audio and the score of a given piece. Standard alignment methods are based on Dynamic Time Warping (DTW) and employ handcrafted featur…
Dynamic Time WarpingOn the Effectiveness of Acoustic BPE in Decoder-Only TTS
Discretizing speech into tokens and generating them by a decoder-only model have been a promising direction for text-to-speech (TTS) and spoken language modeling (SLM). To shorten the sequence length of speech tokens, ac…
DecoderDiversityLanguage ModelingLanguage Modelling+2