LSTM based Similarity Measurement with Spectral Clustering for Speaker Diarization

2019-07-23 · Qingjian Lin, Ruiqing Yin, Ming Li, Hervé Bredin, Claude Barras

More and more neural network approaches have achieved considerable improvement upon submodules of speaker diarization system, including speaker change detection and segment-wise speaker embedding extraction. Still, in the clustering stage, traditional algorithms like probabilistic linear discriminant analysis (PLDA) are widely used for scoring the similarity between two speech segments. In this paper, we propose a supervised method to measure the similarity matrix between all segments of an audio recording with sequential bidirectional long short-term memory networks (Bi-LSTM). Spectral clustering is applied on top of the similarity matrix to further improve the performance. Experimental results show that our system significantly outperforms the state-of-the-art methods and achieves a diarization error rate of 6.63% on the NIST SRE 2000 CALLHOME database.

📄 PDF Abstract BibTeX arXiv:1907.10393

Code (1)

cvqluu/nn-similarity-diarization pytorch

Tasks

Change DetectionClusteringspeaker-diarization Speaker Diarization

Methods 이 논문이 사용한 방법론

Spectral Clustering Spectral clustering has attracted increasing attention due to the promising ability in dealing with nonlinearly separable datasets [15], [16]. In spectral clustering, the…

Bi-LSTM Scoring Based Similarity Measurement with Agglomerative Hierarchical Clustering (AHC) for Speaker Diarization

2022-05-19 · Siddharth S. Nijhawan, Homayoon Beigi

Majority of speech signals across different scenarios are never available with well-defined audio segments containing only a single speaker. A typical conversation between two speakers consists of segments where their vo…

Clustering speaker-diarization Speaker Diarization

DIHARD II is Still Hard: Experimental Results and Discussions from the DKU-LENOVO Team

2020-02-23 · Qingjian Lin, Weicheng Cai, Lin Yang, Jun-Jie Wang 외

In this paper, we present the submitted system for the second DIHARD Speech Diarization Challenge from the DKULENOVO team. Our diarization system includes multiple modules, namely voice activity detection (VAD), segmenta…

Action Detection Activity Detection Clustering

Self-Tuning Spectral Clustering for Speaker Diarization

2024-09-16 · Nikhil Raghav, Avisek Gupta, Md Sahidullah, Swagatam Das

Spectral clustering has proven effective in grouping speech representations for speaker diarization tasks, although post-processing the affinity matrix remains difficult due to the need for careful tuning before construc…

Clustering speaker-diarization Speaker Diarization

Speaker Clustering in Textual Dialogue with Pairwise Utterance Relation and Cross-corpus Dialogue Act Supervision

2022-10-01 · COLING 2022 10 · Zhihua Su, Qiang Zhou

We propose a speaker clustering model for textual dialogues, which groups the utterances of a multi-party dialogue without speaker annotations, so that the actual speakers are identical inside each cluster. We find that,…

Clustering Cross-corpus Dialogue Act Classification Language Modeling+4

Discriminative Neural Clustering for Speaker Diarisation

2019-10-22 · Qiujia Li, Florian L. Kreyssig, Chao Zhang, Philip C. Woodland

In this paper, we propose Discriminative Neural Clustering (DNC) that formulates data clustering with a maximum number of clusters as a supervised sequence-to-sequence learning problem. Compared to traditional unsupervis…

Clustering Data Augmentation