paper-with-me

홈 › Papers

Self-Tuning Spectral Clustering for Speaker Diarization

2024-09-16 · Nikhil Raghav, Avisek Gupta, Md Sahidullah, Swagatam Das

Spectral clustering has proven effective in grouping speech representations for speaker diarization tasks, although post-processing the affinity matrix remains difficult due to the need for careful tuning before constructing the Laplacian. In this study, we present a novel pruning algorithm to create a sparse affinity matrix called spectral clustering on p-neighborhood retained affinity matrix (SC-pNA). Our method improves on node-specific fixed neighbor selection by allowing a variable number of neighbors, eliminating the need for external tuning data as the pruning parameters are derived directly from the affinity matrix. SC-pNA does so by identifying two clusters in every row of the initial affinity matrix, and retains only the top p % similarity scores from the cluster containing larger similarities. Spectral clustering is performed subsequently, with the number of clusters determined as the maximum eigengap. Experimental results on the challenging DIHARD-III dataset highlight the superiority of SC-pNA, which is also computationally more efficient than existing auto-tuning approaches. Our implementations are available at https://github.com/nikhilraghav29/SC-pNA.

📄 PDF Abstract BibTeX arXiv:2410.00023

Code (1)

nikhilraghav29/sc-pna 공식 구현 pytorch

Tasks

Clusteringspeaker-diarizationSpeaker Diarization

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Spectral Clustering Spectral clustering has attracted increasing attention due to the promising ability in dealing with nonlinearly separable datasets [15], [16]. In spectral clustering, the…

Similar Papers 제목 키워드 기반

Assessing the Robustness of Spectral Clustering for Deep Speaker Diarization

2024-03-21 · Nikhil Raghav, Md Sahidullah

Clustering speaker embeddings is crucial in speaker diarization but hasn't received as much focus as other components. Moreover, the robustness of speaker diarization across various datasets hasn't been explored when the…

Clusteringspeaker-diarizationSpeaker Diarization

Auto-Tuning Spectral Clustering for Speaker Diarization Using Normalized Maximum Eigengap

2020-03-05 · Tae Jin Park, Kyu J. Han, Manoj Kumar, Shrikanth Narayanan

In this study, we propose a new spectral clustering framework that can auto-tune the parameters of the clustering algorithm in the context of speaker diarization. The proposed framework uses normalized maximum eigengap (…

Clusteringspeaker-diarizationSpeaker Diarization

TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challenge

2022-10-26 · Bowen Pang, Huan Zhao, Gaosheng Zhang, Xiaoyue Yang 외

This paper describes the TSUP team's submission to the ISCSLP 2022 conversational short-phrase speaker diarization (CSSD) challenge which particularly focuses on short-phrase conversations with a new evaluation metric ca…

Action DetectionActivity Detectionspeaker-diarizationSpeaker Diarization

Speaker Diarization with Lexical Information

2020-04-13 · Tae Jin Park, Kyu J. Han, Jing Huang, Xiaodong He 외

This work presents a novel approach for speaker diarization to leverage lexical information provided by automatic speech recognition. We propose a speaker diarization system that can incorporate word-level speaker turn p…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Clusteringspeaker-diarization+3

Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech

2026-07-09 · Hao Wu, RongQi Han, Zhen Wang, Wei Liang 외 arxiv

This paper describes our self-designed system for Task 1 of the MLC-SLM 2026 Challenge for multilingual two-speaker conversational speech. The system combines a modular speaker diarization front end with a challenge-adap…

Reinforcement LearningSpeaker DiarizationActivity Detection