paper-with-me

Papers

Overlap-aware diarization: resegmentation using neural end-to-end overlapped speech detection

2019-10-25

We address the problem of effectively handling overlapping speech in a diarization system. First, we detail a neural Long Short-Term Memory-based architecture for overlap detection. Secondly, detected overlap regions are exploited in conjunction with a frame-level speaker posterior matrix to make two-speaker assignments for overlapped frames in the resegmentation step. The overlap detection module achieves state-of-the-art performance on the AMI, DIHARD, and ETAPE corpora. We apply overlap-aware resegmentation on AMI, resulting in a 20% relative DER reduction over the baseline system. While this approach is by no means an end-all solution to overlap-aware diarization, it reveals promising directions for handling overlap.

📄 PDF Abstract BibTeX arXiv:1910.11646

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

End-to-end speaker segmentation for overlap-aware resegmentation

2021-04-08 · Hervé Bredin, Antoine Laurent

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detecti…

Action DetectionActivity DetectionChange DetectionMulti-Label Classification+4

Speaker Mask Transformer for Multi-talker Overlapped Speech Recognition

2023-12-18 · Peng Shen, Xugang Lu, Hisashi Kawai

Multi-talker overlapped speech recognition remains a significant challenge, requiring not only speech recognition but also speaker diarization tasks to be addressed. In this paper, to better address these tasks, we first…

speaker-diarizationSpeaker Diarizationspeech-recognitionSpeech Recognition

Community Detection Graph Convolutional Network for Overlap-Aware Speaker Diarization

2023-06-26 · Jie Wang, Zhicong Chen, Haodong Zhou, Lin Li 외

The clustering algorithm plays a crucial role in speaker diarization systems. However, traditional clustering algorithms suffer from the complex distribution of speaker embeddings and lack of digging potential relationsh…

ClusteringCommunity DetectionGraph Generationspeaker-diarization+1

Speaker Diarization with Region Proposal Network

2020-02-14 · Zili Huang, Shinji Watanabe, Yusuke Fujita, Paola Garcia 외

Speaker diarization is an important pre-processing step for many speech applications, and it aims to solve the "who spoke when" problem. Although the standard diarization systems can achieve satisfactory results in vario…

Region Proposalspeaker-diarizationSpeaker Diarization

DIHARD II is Still Hard: Experimental Results and Discussions from the DKU-LENOVO Team

2020-02-23 · Qingjian Lin, Weicheng Cai, Lin Yang, Jun-Jie Wang 외

In this paper, we present the submitted system for the second DIHARD Speech Diarization Challenge from the DKULENOVO team. Our diarization system includes multiple modules, namely voice activity detection (VAD), segmenta…

Action DetectionActivity DetectionClustering