paper-with-me

Papers

Discriminative Training of VBx Diarization

2023-10-04 · Dominik Klement, Mireia Diez, Federico Landini, Lukáš Burget, Anna Silnova, Marc Delcroix, Naohiro Tawara

Bayesian HMM clustering of x-vector sequences (VBx) has become a widely adopted diarization baseline model in publications and challenges. It uses an HMM to model speaker turns, a generatively trained probabilistic linear discriminant analysis (PLDA) for speaker distribution modeling, and Bayesian inference to estimate the assignment of x-vectors to speakers. This paper presents a new framework for updating the VBx parameters using discriminative training, which directly optimizes a predefined loss. We also propose a new loss that better correlates with the diarization error rate compared to binary cross-entropy $\unicode{x2013}$ the default choice for diarization end-to-end systems. Proof-of-concept results across three datasets (AMI, CALLHOME, and DIHARD II) demonstrate the method's capability of automatically finding hyperparameters, achieving comparable performance to those found by extensive grid search, which typically requires additional hyperparameter behavior knowledge. Moreover, we show that discriminative fine-tuning of PLDA can further improve the model's performance. We release the source code with this publication.

📄 PDF Abstract BibTeX arXiv:2310.02732

Code (1)

butspeechfit/dvbx 공식 구현 pytorch

Tasks

Bayesian Inference

Methods 이 논문이 사용한 방법론

Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Similar Papers 제목 키워드 기반

End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings

2021-05-05 · Soumi Maiti, Hakan Erdogan, Kevin Wilson, Scott Wisdom 외

We present an end-to-end deep network model that performs meeting diarization from single-channel audio recordings. End-to-end diarization models have the advantage of handling speaker overlap and enabling straightforwar…

ClusteringSpeaker IdentificationTransfer Learning

Novel Architectures for Unsupervised Information Bottleneck based Speaker Diarization of Meetings

2020-10-13

Speaker diarization is an important problem that is topical, and is especially useful as a preprocessor for conversational speech related applications. The objective of this paper is two-fold: (i) segment initialization …

Clusteringspeaker-diarizationSpeaker Diarization

AVA-AVD: Audio-Visual Speaker Diarization in the Wild

2021-11-29 · Eric Zhongcong Xu, Zeyang Song, Satoshi Tsutsui, Chao Feng 외

Audio-visual speaker diarization aims at detecting "who spoke when" using both auditory and visual signals. Existing audio-visual diarization datasets are mainly focused on indoor environments like meeting rooms or news …

Relation Networkspeaker-diarizationSpeaker Diarization

ECAPA-TDNN Embeddings for Speaker Diarization

2021-04-03 · Nauman Dawalatabad, Mirco Ravanelli, François Grondin, Jenthe Thienpondt 외

Learning robust speaker embeddings is a crucial step in speaker diarization. Deep neural networks can accurately capture speaker discriminative characteristics and popular deep embeddings such as x-vectors are nowadays a…

speaker-diarizationSpeaker DiarizationSpeaker Verification

Leveraging Speaker Embeddings in End-to-End Neural Diarization for Two-Speaker Scenarios

2024-07-01 · Juan Ignacio Alvarez-Trejos, Beltrán Labrador, Alicia Lozano-Diez

End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the en…

speaker-diarizationSpeaker Diarization