paper-with-me

Papers

Utterance-level Sequential Modeling For Deep Gaussian Process Based Speech Synthesis Using Simple Recurrent Unit

2020-04-22 · Tomoki Koriyama, Hiroshi Saruwatari

This paper presents a deep Gaussian process (DGP) model with a recurrent architecture for speech sequence modeling. DGP is a Bayesian deep model that can be trained effectively with the consideration of model complexity and is a kernel regression model that can have high expressibility. In the previous studies, it was shown that the DGP-based speech synthesis outperformed neural network-based one, in which both models used a feed-forward architecture. To improve the naturalness of synthetic speech, in this paper, we show that DGP can be applied to utterance-level modeling using recurrent architecture models. We adopt a simple recurrent unit (SRU) for the proposed model to achieve a recurrent architecture, in which we can execute fast speech parameter generation by using the high parallelization nature of SRU. The objective and subjective evaluation results show that the proposed SRU-DGP-based speech synthesis outperforms not only feed-forward DGP but also automatically tuned SRU- and long short-term memory (LSTM)-based neural networks.

📄 PDF Abstract BibTeX arXiv:2004.10823

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Synthesis

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Highway Layer 설명 없음
SRU SRU, or Simple Recurrent Unit, is a recurrent neural unit with a light form of recurrence. SRU exhibits the same level of parallelism as…
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Large-Context Conversational Representation Learning: Self-Supervised Learning for Conversational Documents

2021-02-16 · Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima 외

This paper presents a novel self-supervised learning method for handling conversational documents consisting of transcribed text of human-to-human conversations. One of the key technologies for understanding conversation…

Language ModelingLanguage ModellingRepresentation LearningScene Segmentation+1

Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation

2021-02-16 · Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima 외

We present a novel large-context end-to-end automatic speech recognition (E2E-ASR) model and its effective training method based on knowledge distillation. Common E2E-ASR models have mainly focused on utterance-level pro…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderKnowledge Distillation+3

Sequential Neural Networks for Noetic End-to-End Response Selection

2020-03-03 · Qian Chen, Wen Wang

The noetic end-to-end response selection challenge as one track in the 7th Dialog System Technology Challenges (DSTC7) aims to push the state of the art of utterance classification for real world goal-oriented dialog sys…

Goal-Oriented Dialog

Sequential Attention-based Network for Noetic End-to-End Response Selection

2019-01-09 · Qian Chen, Wen Wang

The noetic end-to-end response selection challenge as one track in Dialog System Technology Challenges 7 (DSTC7) aims to push the state of the art of utterance classification for real world goal-oriented dialog systems, …

Conversational Response SelectionGoal-Oriented Dialog

Adaptive Batching for Gaussian Process Surrogates with Application in Noisy Level Set Estimation

2020-03-19 · Xiong Lyu, Mike Ludkovski

We develop adaptive replicated designs for Gaussian process metamodels of stochastic experiments. Adaptive batching is a natural extension of sequential design heuristics with the benefit of replication growing as respon…