paper-with-me

홈 › Papers

Synthesizing the Lombard Effect: Multi-Level Control of Speech Clarity and Vocal Effort in TTS

2026-06-22 · Seymanur Akti, Alexander Waibel arxiv

Humans tend to speak louder and clearer in challenging environments, such as noisy conditions or when addressing hearingimpaired listeners, which is called Lombard effect. To simulate this behavior in speech synthesis systems, we introduce a flow-matching based text-to-speech (TTS) model trained with vocal effort and articulation pseudo-labels. The proposed model achieves continuous and disentangled control of vocal effort and articulation, while also enabling word-level emphasis for clarifying specific segments of an utterance. Experimental results show that these control mechanisms effectively improve clarityrelated acoustic features. Furthermore, speech-in-noise experiments demonstrate that our model successfully simulates the intelligibility gains of human clear speech in noisy conditions.

📄 PDF Abstract BibTeX arXiv:2606.23176

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Synthesis

Similar Papers 제목 키워드 기반

Lombard Speech Synthesis for Any Voice with Controllable Style Embeddings

2026-01-19 · Seymanur Akti, Alexander Waibel arxiv

The Lombard effect plays a key role in natural communication, particularly in noisy environments or when addressing hearing-impaired listeners. We present a controllable text-to-speech (TTS) system capable of synthesizin…

Speech Synthesis

Exploring Sentence Type Effects on the Lombard Effect and Intelligibility Enhancement: A Comparative Study of Natural and Grid Sentences

2023-09-19 · Hongyang Chen, Yuhong Yang, Zhongyuan Wang, Weiping tu 외

This study explores how sentence types affect the Lombard effect and intelligibility enhancement, focusing on comparisons between natural and grid sentences. Using the Lombard Chinese-TIMIT (LCT) corpus and the Enhanced …

Sentence

LombardoGraphia: Automatic Classification of Lombard Orthography Variants

2026-03-30 · Edoardo Signoroni, Pavel Rychlý arxiv

Lombard, an underresourced language variety spoken by approximately 3.8 million people in Northern Italy and Southern Switzerland, lacks a unified orthographic standard. Multiple orthographic systems exist, creating chal…

Deep-Learning-Based Audio-Visual Speech Enhancement in Presence of Lombard Effect

2019-05-29 · Daniel Michelsanti, Zheng-Hua Tan, Sigurdur Sigurdsson, Jesper Jensen

When speaking in presence of background noise, humans reflexively change their way of speaking in order to improve the intelligibility of their speech. This reflex is known as Lombard effect. Collecting speech in Lombard…

Speech Enhancement

Robust Pandemic Control Synthesis with Formal Specifications: A Case Study on COVID-19 Pandemic

2021-03-26 · Zhe Xu, Xiaoming Duan

Pandemics can bring a range of devastating consequences to public health and the world economy. Identifying the most effective control strategies has been the imperative task all around the world. Various public health c…