paper-with-me

홈 › Papers

Interpolating Speaker Identities in Embedding Space for Data Expansion

2025-08-26 · Tianchi Liu, Ruijie Tao, Qiongqiong Wang, Yidi Jiang, Hardik B. Sailor, Ke Zhang, Jingru Lin, Haizhou Li arxiv

The success of deep learning-based speaker verification systems is largely attributed to access to large-scale and diverse speaker identity data. However, collecting data from more identities is expensive, challenging, and often limited by privacy concerns. To address this limitation, we propose INSIDE (Interpolating Speaker Identities in Embedding Space), a novel data expansion method that synthesizes new speaker identities by interpolating between existing speaker embeddings. Specifically, we select pairs of nearby speaker embeddings from a pretrained speaker embedding space and compute intermediate embeddings using spherical linear interpolation. These interpolated embeddings are then fed to a text-to-speech system to generate corresponding speech waveforms. The resulting data is combined with the original dataset to train downstream models. Experiments show that models trained with INSIDE-expanded data outperform those trained only on real data, achieving 3.06\% to 5.24\% relative improvements. While INSIDE is primarily designed for speaker verification, we also validate its effectiveness on gender classification, where it yields a 13.44\% relative improvement. Moreover, INSIDE is compatible with other augmentation techniques and can serve as a flexible, scalable addition to existing training pipelines.

📄 PDF Abstract BibTeX arXiv:2508.19210

Code (0)

등록된 구현이 없습니다.

Tasks

Speaker Verification

Similar Papers 제목 키워드 기반

Improving speaker turn embedding by crossmodal transfer learning from face embedding

2017-07-10 · Nam Le, Jean-Marc Odobez

Learning speaker turn embeddings has shown considerable improvement in situations where conventional speaker modeling approaches fail. However, this improvement is relatively limited when compared to the gain observed in…

ClusteringFace VerificationTransfer Learning

Speaker Embeddings to Improve Tracking of Intermittent and Moving Speakers

2025-06-23 · Taous Iatariene, Can Cui, Alexandre Guérin, Romain Serizel

Speaker tracking methods often rely on spatial observations to assign coherent track identities over time. This raises limits in scenarios with intermittent and moving speakers, i.e., speakers that may change position wh…

Position

An analysis on the effects of speaker embedding choice in non auto-regressive TTS

2023-07-19 · Adriana Stan, Johannah O'Mahony

In this paper we introduce a first attempt on understanding how a non-autoregressive factorised multi-speaker speech synthesis architecture exploits the information present in different speaker embedding sets. We analyse…

Representation LearningSpeech Synthesis

Post-Training Embedding Alignment for Decoupling Enrollment and Runtime Speaker Recognition Models

2024-01-23 · Chenyang Gao, Brecht Desplanques, Chelsea J. -T. Ju, Aman Chadha 외

Automated speaker identification (SID) is a crucial step for the personalization of a wide range of speech-enabled services. Typical SID systems use a symmetric enrollment-verification framework with a single model to de…

Speaker IdentificationSpeaker Recognition

MIRNet: Learning multiple identities representations in overlapped speech

2020-08-04 · Hyewon Han, Soo-Whan Chung, Hong-Goo Kang

Many approaches can derive information about a single speaker's identity from the speech by learning to recognize consistent characteristics of acoustic parameters. However, it is challenging to determine identity inform…

Rgb-T TrackingSpeaker VerificationSpeech Separation