paper-with-me

홈 › Papers

An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-shot Multi-speaker TTS

2025-06-25 · Marie Kunešová, Zdeněk Hanzlíček, Jindřich Matoušek

Zero-shot multi-speaker text-to-speech (TTS) systems rely on speaker embeddings to synthesize speech in the voice of an unseen speaker, using only a short reference utterance. While many speaker embeddings have been developed for speaker recognition, their relative effectiveness in zero-shot TTS remains underexplored. In this work, we employ a YourTTS-based TTS system to compare three different speaker encoders - YourTTS's original H/ASP encoder, x-vector embeddings, and ECAPA-TDNN embeddings - within an otherwise fixed zero-shot TTS framework. All models were trained on the same dataset of Czech read speech and evaluated on 24 out-of-domain target speakers using both subjective and objective methods. The subjective evaluation was conducted via a listening test focused on speaker similarity, while the objective evaluation measured cosine distances between speaker embeddings extracted from synthesized and real utterances. Across both evaluations, the original H/ASP encoder consistently outperformed the alternatives, with ECAPA-TDNN showing better results than x-vectors. These findings suggest that, despite the popularity of ECAPA-TDNN in speaker recognition, it does not necessarily offer improvements for speaker similarity in zero-shot TTS in this configuration. Our study highlights the importance of empirical evaluation when reusing speaker recognition embeddings in TTS and provides a framework for additional future comparisons.

📄 PDF Abstract BibTeX arXiv:2506.20190

Code (0)

등록된 구현이 없습니다.

Tasks

Speaker Recognitiontext-to-speechText to SpeechZero-Shot Multi-Speaker TTS

Similar Papers 제목 키워드 기반

ECAPA-TDNN Embeddings for Speaker Diarization

2021-04-03 · Nauman Dawalatabad, Mirco Ravanelli, François Grondin, Jenthe Thienpondt 외

Learning robust speaker embeddings is a crucial step in speaker diarization. Deep neural networks can accurately capture speaker discriminative characteristics and popular deep embeddings such as x-vectors are nowadays a…

speaker-diarizationSpeaker DiarizationSpeaker Verification

FT-Boosted SV: Towards Noise Robust Speaker Verification for English Speaking Classroom Environments

2025-05-26 · Saba Tabatabaee, Jing Liu, Carol Espy-Wilson

Creating Speaker Verification (SV) systems for classroom settings that are robust to classroom noises such as babble noise is crucial for the development of AI tools that assist educational environments. In this work, we…

Speaker Verification

Probing Deep Speaker Embeddings for Speaker-related Tasks

2022-12-14 · Zifeng Zhao, Ding Pan, Junyi Peng, Rongzhi Gu

Deep speaker embeddings have shown promising results in speaker recognition, as well as in other speaker-related tasks. However, some issues are still under explored, for instance, the information encoded in these repres…

Speaker RecognitionSpeaker Verificationtext-to-speechText to Speech

HLT-NUS SUBMISSION FOR 2020 NIST Conversational Telephone Speech SRE

2021-11-12 · Rohan Kumar Das, Ruijie Tao, Haizhou Li

This work provides a brief description of Human Language Technology (HLT) Laboratory, National University of Singapore (NUS) system submission for 2020 NIST conversational telephone speech (CTS) speaker recognition evalu…

Domain AdaptationSpeaker Recognition

NeXt-TDNN: Modernizing Multi-Scale Temporal Convolution Backbone for Speaker Verification

2023-12-14 · Hyun-Jun Heo, Ui-Hyeop Shin, Ran Lee, YoungJu Cheon 외

In speaker verification, ECAPA-TDNN has shown remarkable improvement by utilizing one-dimensional(1D) Res2Net block and squeeze-and-excitation(SE) module, along with multi-layer feature aggregation (MFA). Meanwhile, in v…

Speaker Verification