paper-with-me

Papers

Dr-Vectors: Decision Residual Networks and an Improved Loss for Speaker Recognition

2021-04-05 · Jason Pelecanos, Quan Wang, Ignacio Lopez Moreno

Many neural network speaker recognition systems model each speaker using a fixed-dimensional embedding vector. These embeddings are generally compared using either linear or 2nd-order scoring and, until recently, do not handle utterance-specific uncertainty. In this work we propose scoring these representations in a way that can capture uncertainty, enroll/test asymmetry and additional non-linear information. This is achieved by incorporating a 2nd-stage neural network (known as a decision network) as part of an end-to-end training regimen. In particular, we propose the concept of decision residual networks which involves the use of a compact decision network to leverage cosine scores and to model the residual signal that's needed. Additionally, we present a modification to the generalized end-to-end softmax loss function to target the separation of same/different speaker scores. We observed significant performance gains for the two techniques.

📄 PDF Abstract BibTeX arXiv:2104.01989

Code (1)

google/speaker-id/tree/master/lingvo 공식 구현

Tasks

Speaker Recognition

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Auxiliary Loss of Transformer with Residual Connection for End-to-End Speaker Diarization

2021-10-14 · Yechan Yu, Dongkeon Park, Hong Kook Kim

End-to-end neural diarization (EEND) with self-attention directly predicts speaker labels from inputs and enables the handling of overlapped speech. Although the EEND outperforms clustering-based speaker diarization (SD)…

speaker-diarizationSpeaker Diarization

Learning Speaker Embedding from Text-to-Speech

2020-10-21 · Jaejin Cho, Piotr Zelasko, Jesus Villalba, Shinji Watanabe 외

Zero-shot multi-speaker Text-to-Speech (TTS) generates target speaker voices given an input text and the corresponding speaker embedding. In this work, we investigate the effectiveness of the TTS reconstruction objective…

ClassificationDecoderGeneral ClassificationRepresentation Learning+3

Target-speaker Voice Activity Detection with Improved I-Vector Estimation for Unknown Number of Speaker

2021-08-07 · Maokui He, Desh Raj, Zili Huang, Jun Du 외

Target-speaker voice activity detection (TS-VAD) has recently shown promising results for speaker diarization on highly overlapped speech. However, the original model requires a fixed (and known) number of speakers, whic…

Action DetectionActivity DetectionRegion Proposalspeaker-diarization+1

Binary Speaker Embedding

2015-10-20 · Lantian Li, Dong Wang, Chao Xing, Kaimin Yu 외

The popular i-vector model represents speakers as low-dimensional continuous vectors (i-vectors), and hence it is a way of continuous speaker embedding. In this paper, we investigate binary speaker embedding, which trans…

BinarizationSpeaker Verification

Geodesic interpolation of frame-wise speaker embeddings for the diarization of meeting scenarios

2024-01-08 · Tobias Cord-Landwehr, Christoph Boeddeker, Cătălin Zorilă, Rama Doddipatla 외

We propose a modified teacher-student training for the extraction of frame-wise speaker embeddings that allows for an effective diarization of meeting scenarios containing partially overlapping speech. To this end, a geo…

Clustering