paper-with-me

Papers

Using Prosody to Predict Syntactic Structure

2026-08-31 · Junghyun Min, Alex Warstadt, Tamar I. Regev, Tiago Pimentel, Ethan Gotlieb Wilcox arxiv

While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two domains remains contested. We investigate the syntax-prosody interface through an information-theoretic lens, quantifying the interaction between prosodic features and syntactic representations as their mutual information. We provide a general-purpose framework for estimating this quantity over large speech-text corpora using multimodal language models. Our framework is structure-agnostic and modular, insofar as it can be used to measure the contributions of individual prosodic features or components of structure. We evaluate the syntax-prosody relationship for two features (word duration and inter-word pauses) across two domains--read audiobooks and spontaneous conversations--both in English. Our results demonstrate that prosody contains measurable syntactic information, with prosodic features reducing syntactic uncertainty in spontaneous conversations by up to 10.2%. Our findings offer new empirical support for several theoretical accounts of the syntax-prosody interface.

📄 PDF Abstract BibTeX arXiv:2608.30260

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS

2019-04-09 · Haohan Guo, Frank K. Soong, Lei He, Lei Xie

The end-to-end TTS, which can predict speech directly from a given sequence of graphemes or phonemes, has shown improved performance over the conventional TTS. However, its predicting capability is still limited by the a…

Sentence

Logical Transductions for the Typology of Ditransitive Prosody

2022-07-01 · NAACL (SIGMORPHON) 2022 7 · Mai Ha Vu, Aniello De Santo, Hossep Dolatian

Given the empirical landscape of possible prosodic parses, this paper examines the computations required to formalize the mapping from syntactic structure to prosodic structure. In particular, we use logical tree transdu…

PauseSpeech: Natural Speech Synthesis via Pre-trained Language Model and Pause-based Prosody Modeling

2023-06-13 · Ji-Sang Hwang, Sang-Hoon Lee, Seong-Whan Lee

Although text-to-speech (TTS) systems have significantly improved, most TTS systems still have limitations in synthesizing speech with appropriate phrasing. For natural speech synthesis, it is important to synthesize the…

Language ModelingLanguage ModellingSpeech Synthesistext-to-speech+1

An Empirical Analysis of the Correlation of Syntax and Prosody

2018-06-15 · Arne Köhn, Timo Baumann, Oskar Dörfler

The relation of syntax and prosody (the syntax--prosody interface) has been an active area of research, mostly in linguistics and typically studied under controlled conditions. More recently, prosody has also been succes…

Syntactic representation learning for neural network based TTS with syntactic parse tree traversal

2020-12-13 · Changhe Song, Jingbei Li, Yixuan Zhou, Zhiyong Wu 외

Syntactic structure of a sentence text is correlated with the prosodic structure of the speech that is crucial for improving the prosody and naturalness of a text-to-speech (TTS) system. Nowadays TTS systems usually try …

DiversityRepresentation LearningSentencetext-to-speech+1