Toeplitz Inverse Covariance based Robust Speaker Clustering for Naturalistic Audio Streams
Speaker diarization determines who spoke and when? in an audio stream. In this study, we propose a model-based approach for robust speaker clustering using i-vectors. The ivectors extracted from different segments of same speaker are correlated. We model this correlation with a Markov Random Field (MRF) network. Leveraging the advancements in MRF modeling, we used Toeplitz Inverse Covariance (TIC) matrix to represent the MRF correlation network for each speaker. This approaches captures the sequential structure of i-vectors (or equivalent speaker turns) belonging to same speaker in an audio stream. A variant of standard Expectation Maximization (EM) algorithm is adopted for deriving closed-form solution using dynamic programming (DP) and the alternating direction method of multiplier (ADMM). Our diarization system has four steps: (1) ground-truth segmentation; (2) i-vector extraction; (3) post-processing (mean subtraction, principal component analysis, and length-normalization) ; and (4) proposed speaker clustering. We employ cosine K-means and movMF speaker clustering as baseline approaches. Our evaluation data is derived from: (i) CRSS-PLTL corpus, and (ii) two meetings subset of the AMI corpus. Relative reduction in diarization error rate (DER) for CRSS-PLTL corpus is 43.22% using the proposed advancements as compared to baseline. For AMI meetings IS1000a and IS1003b, relative DER reduction is 29.37% and 9.21%, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Clusteringspeaker-diarizationSpeaker DiarizationSimilar Papers 제목 키워드 기반
Gohberg-Semencul Estimation of Toeplitz Structured Covariance Matrices and Their Inverses
When only few data samples are accessible, utilizing structural prior knowledge is essential for estimating covariance matrices and their inverses. One prominent example is knowing the covariance matrix to be Toeplitz st…
"Blind" Calibration and Toeplitz Covariance Matrix Estimation in Uniform Linear Arrays. Part I. Benchmark Analysis and Matrix-Free Techniques
The problems of uniform linear array (with uniform mutual coupling) calibration and Toeplitz covariance matrix estimation are re-examined for application in the receive arrays of modern High Frequency Over-the-Horizon Ra…
Toeplitz Inverse Eigenvalue Problem: Application to the Uniform Linear Antenna Array Calibration
The inverse Toeplitz eigenvalue problem (ToIEP) concerns finding a vector that specifies the real-valued symmetric Toeplitz matrix with the prescribed set of eigenvalues. Since phase "calibration" errors in uniform linea…
Toeplitz Inverse Covariance-Based Clustering of Multivariate Time Series Data
Subsequence clustering of multivariate time series is a useful tool for discovering repeated patterns in temporal data. Once these patterns have been discovered, seemingly complicated datasets can be interpreted as a tem…
ClusteringTime SeriesTime Series AnalysisToeplitz Inverse Eigenvalue Problem (ToIEP) and Random Matrix Theory (RMT) Support for the Toeplitz Covariance Matrix Estimation
"Toeplitzification" or "redundancy (spatial) averaging", the well-known routine for deriving the Toeplitz covariance matrix estimate from the standard sample covariance matrix, recently regained new attention due to the …