paper-with-me

홈 › Papers

Voice Imitating Text-to-Speech Neural Networks

2018-06-04 · journal 2018 6 · Young-Gun Lee, Taesu Kim, Soo-Young Lee

We propose a neural text-to-speech (TTS) model that can imitate a new speaker's voice using only a small amount of speech sample. We demonstrate voice imitation using only a 6-seconds long speech sample without any other information such as transcripts. Our model also enables voice imitation instantly without additional training of the model. We implemented the voice imitating TTS model by combining a speaker embedder network with a state-of-the-art TTS model, Tacotron. The speaker embedder network takes a new speaker's speech sample and returns a speaker embedding. The speaker embedding with a target sentence are fed to Tacotron, and speech is generated with the new speaker's voice. We show that the speaker embeddings extracted by the speaker embedder network can represent the latent structure in different voices. The generated speech samples from our model have comparable voice quality to the ones from existing multi-speaker TTS models.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Sentencetext-to-speechText to Speech

Methods 이 논문이 사용한 방법론

Griffin-Lim Algorithm The Griffin-Lim Algorithm (GLA) is a phase reconstruction method based on the redundancy of the short-time Fourier transform. It promotes the consistency of a spectrogram by…
Sigmoid Activation 설명 없음
Highway Layer 설명 없음
Residual Connection 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Batch Normalization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Residual GRU A Residual GRU is a gated recurrent unit (GRU) that incorporates the idea of residual connections from…

Similar Papers 제목 키워드 기반

LoRP-TTS: Low-Rank Personalized Text-To-Speech

2025-02-11 · Łukasz Bondaruk, Jakub Kubiak

Speech synthesis models convert written text into natural-sounding audio. While earlier models were limited to a single speaker, recent advancements have led to the development of zero-shot systems that generate realisti…

Speech Synthesistext-to-speechText to Speech

Speech Synthesis with Mixed Emotions

2022-08-11 · Kun Zhou, Berrak Sisman, Rajib Rana, B. W. Schuller 외

Emotional speech synthesis aims to synthesize human voices with various emotional effects. The current studies are mostly focused on imitating an averaged style belonging to a specific emotion type. In this paper, we see…

AttributeEmotional Speech SynthesisSpeech Synthesistext-to-speech+1

The I3MEDIA speech database: a trilingual annotated corpus for the analysis and synthesis of emotional speech

2012-05-01 · LREC 2012 5 · Juan Mar{\'\i}a Garrido, Yesika Laplaza, Montse Marquina, Andrea Pearman 외

In this article the I3Media corpus is presented, a trilingual (Catalan, English, Spanish) speech database of neutral and emotional material collected for analysis and synthesis purposes. The corpus is actually made up of…

PromptTTS 2: Describing and Generating Voices with Text Prompt

2023-09-05 · Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan 외

Speech conveys more information than text, as the same word can be uttered in various voices to convey diverse information. Compared to traditional text-to-speech (TTS) methods relying on speech prompts (reference speech…

Language ModellingLarge Language Modeltext-to-speechText to Speech

IntrinsicVoice: Empowering LLMs with Intrinsic Real-time Voice Interaction Abilities

2024-10-09 · Xin Zhang, Xiang Lyu, Zhihao Du, Qian Chen 외

Current methods of building LLMs with voice interaction capabilities rely heavily on explicit text autoregressive generation before or during speech response generation to maintain content quality, which unfortunately br…

Response Generation