Advancing the dimensionality reduction of speaker embeddings for speaker diarisation: disentangling noise and informing speech activity
The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as noise, adversely affecting performance. Our previous work has proposed an auto-encoder-based dimensionality reduction module to help remove the redundant information. However, they do not explicitly separate such information and have also been found to be sensitive to hyper-parameter values. To this end, we propose two contributions to overcome these issues: (i) a novel dimensionality reduction framework that can disentangle spurious information from the speaker embeddings; (ii) the use of speech activity vector to prevent the speaker code from representing the background noise. Through a range of experiments conducted on four datasets, our approach consistently demonstrates the state-of-the-art performance among models without system fusion.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionSimilar Papers 제목 키워드 기반
Adapting Speaker Embeddings for Speaker Diarisation
The goal of this paper is to adapt speaker embeddings for solving the problem of speaker diarisation. The quality of speaker embeddings is paramount to the performance of speaker diarisation systems. Despite this, prior …
ClusteringDimensionality ReductionSpeaker VerificationGenerative Adversarial Speaker Embedding Networks for Domain Robust End-to-End Speaker Verification
This article presents a novel approach for learning domain-invariant speaker embeddings using Generative Adversarial Networks. The main idea is to confuse a domain discriminator so that is can't tell if embeddings are fr…
Dimensionality ReductionSpeaker VerificationM-Vec: Matryoshka Speaker Embeddings with Flexible Dimensions
Fixed-dimensional speaker embeddings have become the dominant approach in speaker modeling, typically spanning hundreds to thousands of dimensions. These dimensions are hyperparameters that are not specifically picked, n…
Speaker VerificationAnalyzing And Improving Neural Speaker Embeddings for ASR
Neural speaker embeddings encode the speaker's speech characteristics through a DNN model and are prevalent for speaker verification tasks. However, few studies have investigated the usage of neural speaker embeddings fo…
Speaker VerificationContent-Aware Speaker Embeddings for Speaker Diarisation
Recent speaker diarisation systems often convert variable length speech segments into fixed-length vector representations for speaker clustering, which are known as speaker embeddings. In this paper, the content-aware sp…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)ClusteringSpeaker Recognition+3