Adapting Speaker Embeddings for Speaker Diarisation
The goal of this paper is to adapt speaker embeddings for solving the problem of speaker diarisation. The quality of speaker embeddings is paramount to the performance of speaker diarisation systems. Despite this, prior works in the field have directly used embeddings designed only to be effective on the speaker verification task. In this paper, we propose three techniques that can be used to better adapt the speaker embeddings for diarisation: dimensionality reduction, attention-based embedding aggregation, and non-speech clustering. A wide range of experiments is performed on various challenging datasets. The results demonstrate that all three techniques contribute positively to the performance of the diarisation system achieving an average relative improvement of 25.07% in terms of diarisation error rate over the baseline.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDimensionality ReductionSpeaker VerificationSimilar Papers 제목 키워드 기반
Content-Aware Speaker Embeddings for Speaker Diarisation
Recent speaker diarisation systems often convert variable length speech segments into fixed-length vector representations for speaker clustering, which are known as speaker embeddings. In this paper, the content-aware sp…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)ClusteringSpeaker Recognition+3Joint speaker diarisation and tracking in switching state-space model
Speakers may move around while diarisation is being performed. When a microphone array is used, the instantaneous locations of where the sounds originated from can be estimated, and previous investigations have shown tha…
Advancing the dimensionality reduction of speaker embeddings for speaker diarisation: disentangling noise and informing speech activity
The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious in…
Dimensionality ReductionMulti-scale speaker embedding-based graph attention networks for speaker diarisation
The objective of this work is effective speaker diarisation using multi-scale speaker embeddings. Typically, there is a trade-off between the ability to recognise short speaker segments and the discriminative power of th…
Graph AttentionDiarisation using location tracking with agglomerative clustering
Previous works have shown that spatial location information can be complementary to speaker embeddings for a speaker diarisation task. However, the models used often assume that speakers are fairly stationary throughout …
Clustering