Disentangled Speaker Representation Learning via Mutual Information Minimization
Domain mismatch problem caused by speaker-unrelated feature has been a major topic in speaker recognition. In this paper, we propose an explicit disentanglement framework to unravel speaker-relevant features from speaker-unrelated features via mutual information (MI) minimization. To achieve our goal of minimizing MI between speaker-related and speaker-unrelated features, we adopt a contrastive log-ratio upper bound (CLUB), which exploits the upper bound of MI. Our framework is constructed in a 3-stage structure. First, in the front-end encoder, input speech is encoded into shared initial embedding. Next, in the decoupling block, shared initial embedding is split into separate speaker-related and speaker-unrelated embeddings. Finally, disentanglement is conducted by MI minimization in the last stage. Experiments on Far-Field Speaker Verification Challenge 2022 (FFSVC2022) demonstrate that our proposed framework is effective for disentanglement. Also, to utilize domain-unknown datasets containing numerous speakers, we pre-trained the front-end encoder with VoxCeleb datasets. We then fine-tuned the speaker embedding model in the disentanglement framework with FFSVC 2022 dataset. The experimental results show that fine-tuning with a disentanglement framework on a existing pre-trained model is valid and can further improve performance.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementRepresentation LearningSpeaker RecognitionSpeaker VerificationvalidSimilar Papers 제목 키워드 기반
Disentangling Age and Identity with a Mutual Information Minimization Approach for Cross-Age Speaker Verification
There has been an increasing research interest in cross-age speaker verification~(CASV). However, existing speaker verification systems perform poorly in CASV due to the great individual differences in voice caused by ag…
Representation LearningSpeaker VerificationMutual Information Minimization Based Disentangled Learning Framework For Causal Effect Estimation
Learning treatment effect from observational data is a fundamental problem in causal inference. Recently, disentangled representation learning methods, such as DR-CFR and DeR-CFR, have witnessed great success in treatmen…
Causal InferenceRepresentation LearningLearning Disentangled Representations for Counterfactual Regression via Mutual Information Minimization
Learning individual-level treatment effect is a fundamental problem in causal inference and has received increasing attention in many areas, especially in the user growth area which concerns many internet companies. Rece…
Causal InferencecounterfactualMulti-Task Learningregression+1Disentangled Representation for Age-Invariant Face Recognition: A Mutual Information Minimization Perspective
General face recognition has seen remarkable progress in recent years. However, large age gap still remains a big challenge due to significant alterations in facial appearance and bone structure. Disentanglement play…
Age-Invariant Face RecognitionDisentanglementFace RecognitionMORPH+2Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detection
In this paper, we present a weakly-supervised RGB-D salient object detection model via scribble supervision. Specifically, as a multimodal learning task, we focus on effective multimodal representation learning via inter…
Objectobject-detectionObject DetectionPrediction+3