Leveraging Speaker Embeddings in End-to-End Neural Diarization for Two-Speaker Scenarios
End-to-end neural speaker diarization systems are able to address the speaker diarization task while effectively handling speech overlap. This work explores the incorporation of speaker information embeddings into the end-to-end systems to enhance the speaker discriminative capabilities, while maintaining their overlap handling strengths. To achieve this, we propose several methods for incorporating these embeddings along the acoustic features. Furthermore, we delve into an analysis of the correct handling of silence frames, the window length for extracting speaker embeddings and the transformer encoder size. The effectiveness of our proposed approach is thoroughly evaluated on the CallHome dataset for the two-speaker diarization task, with results that demonstrate a significant reduction in diarization error rates achieving a relative improvement of a 10.78% compared to the baseline end-to-end model.
Code (0)
등록된 구현이 없습니다.
Tasks
speaker-diarizationSpeaker DiarizationSimilar Papers 제목 키워드 기반
Geodesic interpolation of frame-wise speaker embeddings for the diarization of meeting scenarios
We propose a modified teacher-student training for the extraction of frame-wise speaker embeddings that allows for an effective diarization of meeting scenarios containing partially overlapping speech. To this end, a geo…
ClusteringDiarization-Aware Multi-Speaker Automatic Speech Recognition via Large Language Models
Multi-speaker automatic speech recognition (MS-ASR) faces significant challenges in transcribing overlapped speech, a task critical for applications like meeting transcription and conversational analysis. While serialize…
Automatic Speech Recognitionspeaker-diarizationSpeaker Diarizationspeech-recognition+1EEND-DEMUX: End-to-End Neural Speaker Diarization via Demultiplexed Speaker Embeddings
In recent years, there have been studies to further improve the end-to-end neural speaker diarization (EEND) systems. This letter proposes the EEND-DEMUX model, a novel framework utilizing demultiplexed speaker embedding…
speaker-diarizationSpeaker DiarizationMulti-Stream Extension of Variational Bayesian HMM Clustering (MS-VBx) for Combined End-to-End and Vector Clustering-based Diarization
Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings …
Clusteringspeaker-diarizationSpeaker DiarizationSpeaker Diarization with Region Proposal Network
Speaker diarization is an important pre-processing step for many speech applications, and it aims to solve the "who spoke when" problem. Although the standard diarization systems can achieve satisfactory results in vario…
Region Proposalspeaker-diarizationSpeaker Diarization