paper-with-me

Papers

Borderless Long Speech Synthesis

2026-03-20 · Xingchen Song, Di Wu, Dinghao Zhou, Pengyu Cheng, Hongwu Ding, Yunchao He, Jie Wang, Shengfan Shen, Sixiang Lv, Lichun Fan, Hang Su, Yifeng Wang, Shuai Wang, Meng Meng, Jian Luan arxiv

Most existing text-to-speech (TTS) systems either synthesize speech sentence by sentence and stitch the results together, or drive synthesis from plain-text dialogues alone. Both approaches leave models with little understanding of global context or paralinguistic cues, making it hard to capture real-world phenomena such as multi-speaker interactions (interruptions, overlapping speech), evolving emotional arcs, and varied acoustic environments. We introduce the Borderless Long Speech Synthesis framework for agent-centric, borderless long audio synthesis. Rather than targeting a single narrow task, the system is designed as a unified capability set spanning VoiceDesigner, multi-speaker synthesis, Instruct TTS, and long-form text synthesis. On the data side, we propose a "Labeling over filtering/cleaning" strategy and design a top-down, multi-level annotation schema we call Global-Sentence-Token. On the model side, we adopt a backbone with a continuous tokenizer and add Chain-of-Thought (CoT) reasoning together with Dimension Dropout, both of which markedly improve instruction following under complex conditions. We further show that the system is Native Agentic by design: the hierarchical annotation doubles as a Structured Semantic Interface between the LLM Agent and the synthesis engine, creating a layered control protocol stack that spans from scene semantics down to phonetic detail. Text thereby becomes an information-complete, wide-band control channel, enabling a front-end LLM to convert inputs of any modality into structured generation commands, extending the paradigm from Text2Speech to borderless long speech synthesis.

📄 PDF Abstract BibTeX arXiv:2603.19798

Code (0)

등록된 구현이 없습니다.

Tasks

Instruction FollowingSpeech Synthesis

Similar Papers 제목 키워드 기반

Byakto Speech: Real-time long speech synthesis with convolutional neural network: Transfer learning from English to Bangla

2021-05-31 · Zabir Al Nazi, Sayed Mohammed Tasmimul Huda

Speech synthesis is one of the challenging tasks to automate by deep learning, also being a low-resource language there are very few attempts at Bangla speech synthesis. Most of the existing works can't work with anythin…

Deep Learningspeech-recognitionSpeech RecognitionSpeech Synthesis+1

Boosting Chinese ASR Error Correction with Dynamic Error Scaling Mechanism

2023-08-07 · Jiaxin Fan, Yong Zhang, Hanzhang Li, Jianzong Wang 외

Chinese Automatic Speech Recognition (ASR) error correction presents significant challenges due to the Chinese language's unique features, including a large character set and borderless, morpheme-based structure. Current…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Deep Feed-forward Sequential Memory Networks for Speech Synthesis

2018-02-26 · Mengxiao Bi, Heng Lu, Shiliang Zhang, Ming Lei 외

The Bidirectional LSTM (BLSTM) RNN based speech synthesis system is among the best parametric Text-to-Speech (TTS) systems in terms of the naturalness of generated speech, especially the naturalness in prosody. However, …

speech-recognitionSpeech RecognitionSpeech Synthesistext-to-speech+1

CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment

2026-02-23 · Hanwen Liu, Saierdaer Yusuyin, Hao Huang, Zhijian Ou arxiv

Large-language-model (LLM)-based text-to-speech (TTS) systems can generate natural speech, but most are not designed for low-latency dual-streaming synthesis. High-quality dual-streaming TTS depends on accurate text--spe…

TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese

2020-05-11 · Edresson Casanova, Arnaldo Candido Junior, Christopher Shulby, Frederico Santos de Oliveira 외

Speech provides a natural way for human-computer interaction. In particular, speech synthesis systems are popular in different applications, such as personal assistants, GPS applications, screen readers and accessibility…

DenoisingSpeech SynthesisTransfer Learning