paper-with-me

홈 › Papers

Triplet Network with Attention for Speaker Diarization

2018-08-04 · Huan Song, Megan Willi, Jayaraman J. Thiagarajan, Visar Berisha, Andreas Spanias

In automatic speech processing systems, speaker diarization is a crucial front-end component to separate segments from different speakers. Inspired by the recent success of deep neural networks (DNNs) in semantic inferencing, triplet loss-based architectures have been successfully used for this problem. However, existing work utilizes conventional i-vectors as the input representation and builds simple fully connected networks for metric learning, thus not fully leveraging the modeling power of DNN architectures. This paper investigates the importance of learning effective representations from the sequences directly in metric learning pipelines for speaker diarization. More specifically, we propose to employ attention models to learn embeddings and the metric jointly in an end-to-end fashion. Experiments are conducted on the CALLHOME conversational speech corpus. The diarization results demonstrate that, besides providing a unified model, the proposed approach achieves improved performance when compared against existing approaches.

📄 PDF Abstract BibTeX arXiv:1808.01535

Code (0)

등록된 구현이 없습니다.

Tasks

Metric Learningspeaker-diarizationSpeaker DiarizationTriplet

Similar Papers 제목 키워드 기반

Self-supervised learning for audio-visual speaker diarization

2020-02-13 · Yifan Ding, Yong Xu, Shi-Xiong Zhang, Yahuan Cong 외

Speaker diarization, which is to find the speech segments of specific speakers, has been widely used in human-centered applications such as video conferences or human-computer interaction systems. In this paper, we propo…

Self-Supervised Learningspeaker-diarizationSpeaker DiarizationTriplet+1

End-to-End Neural Diarization: Reformulating Speaker Diarization as Simple Multi-label Classification

2020-02-24 · Yusuke Fujita, Shinji Watanabe, Shota Horiguchi, Yawen Xue 외

The most common approach to speaker diarization is clustering of speaker embeddings. However, the clustering-based approach has a number of problems; i.e., (i) it is not optimized to minimize diarization errors directly,…

ClusteringGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+2

Speaker Embeddings With Weakly Supervised Voice Activity Detection For Efficient Speaker Diarization

2024-05-15 · Jenthe Thienpondt, Kris Demuynck

Current speaker diarization systems rely on an external voice activity detection model prior to speaker embedding extraction on the detected speech segments. In this paper, we establish that the attention system of a spe…

Action DetectionActivity Detectionspeaker-diarizationSpeaker Diarization+1

End-to-End Neural Speaker Diarization with Self-attention

2019-09-13 · Yusuke Fujita, Naoyuki Kanda, Shota Horiguchi, Yawen Xue 외

Speaker diarization has been mainly developed based on the clustering of speaker embeddings. However, the clustering-based approach has two major problems; i.e., (i) it is not optimized to minimize diarization errors dir…

Clusteringspeaker-diarizationSpeaker Diarization

Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagation

2023-09-19 · Luyao Cheng, Siqi Zheng, Qinglin Zhang, Hui Wang 외

Speaker diarization has gained considerable attention within speech processing research community. Mainstream speaker diarization rely primarily on speakers' voice characteristics extracted from acoustic signals and ofte…

speaker-diarizationSpeaker DiarizationSpoken Language Understanding