paper-with-me

Papers

A Character-level Span-based Model for Mandarin Prosodic Structure Prediction

2022-03-31 · Xueyuan Chen, Changhe Song, Yixuan Zhou, Zhiyong Wu, Changbin Chen, Zhongqin Wu, Helen Meng

The accuracy of prosodic structure prediction is crucial to the naturalness of synthesized speech in Mandarin text-to-speech system, but now is limited by widely-used sequence-to-sequence framework and error accumulation from previous word segmentation results. In this paper, we propose a span-based Mandarin prosodic structure prediction model to obtain an optimal prosodic structure tree, which can be converted to corresponding prosodic label sequence. Instead of the prerequisite for word segmentation, rich linguistic features are provided by Chinese character-level BERT and sent to encoder with self-attention architecture. On top of this, span representation and label scoring are used to describe all possible prosodic structure trees, of which each tree has its corresponding score. To find the optimal tree with the highest score for a given sentence, a bottom-up CKY-style algorithm is further used. The proposed method can predict prosodic labels of different levels at the same time and accomplish the process directly from Chinese characters in an end-to-end manner. Experiment results on two real-world datasets demonstrate the excellent performance of our span-based method over all sequence-to-sequence baseline approaches.

📄 PDF Abstract BibTeX arXiv:2203.16922

Code (1)

thuhcsi/spanpsp 공식 구현 pytorch

Tasks

Sentencetext-to-speechText to Speech

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Weight Decay 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Improving Mandarin Prosodic Structure Prediction with Multi-level Contextual Information

2023-08-31 · Jie Chen, Changhe Song, Deyi Tuo, Xixin Wu 외

For text-to-speech (TTS) synthesis, prosodic structure prediction (PSP) plays an important role in producing natural and intelligible speech. Although inter-utterance linguistic information can influence the speech inter…

DecoderMulti-Task Learningtext-to-speechText to Speech

Quantity Convergence, Quality Divergence: Disentangling Fluency and Accuracy in L2 Mandarin Prosody

2026-02-26 · Yuqi Shi, Hao Yang, Xiyao Lu, Jinsong Zhang arxiv

While second language (L2) learners may acquire target syntactic word order, mapping this syntax onto appropriate prosodic structures remains a persistent challenge. This study investigates the fossilization and stabilit…

Annotating a corpus of human interaction with prosodic profiles --- focusing on Mandarin repair/disfluency

2012-05-01 · LREC 2012 5 · Helen Kai-yun Chen

This study describes the construction of a manually annotated speech corpus that focuses on the sound profiles of repair/disfluency in Mandarin conversational interaction. Specifically, the paper focuses on how the tag s…

TAG

Prosodic ABX: A Language-Agnostic Method for Measuring Prosodic Contrast in Speech Representations

2026-04-02 · Haitong Sun, Stephen McIntosh, Kwanghee Choi, Eunjung Yeo 외 arxiv

Speech representations from self-supervised speech models (S3Ms) are known to be sensitive to phonemic contrasts, but their sensitivity to prosodic contrasts has not been directly measured. The ABX discrimination task ha…

Prosodic Organization and Focus Realization in Taiwan Mandarin

2018-12-01 · PACLIC 2018 12 · Yu-Yin Hsu, James German