paper-with-me

홈 › Papers

Exploring Speaker-Related Information in Spoken Language Understanding for Better Speaker Diarization

2023-05-22 · Luyao Cheng, Siqi Zheng, Zhang Qinglin, Hui Wang, Yafeng Chen, Qian Chen

Speaker diarization(SD) is a classic task in speech processing and is crucial in multi-party scenarios such as meetings and conversations. Current mainstream speaker diarization approaches consider acoustic information only, which result in performance degradation when encountering adverse acoustic conditions. In this paper, we propose methods to extract speaker-related information from semantic content in multi-party meetings, which, as we will show, can further benefit speaker diarization. We introduce two sub-tasks, Dialogue Detection and Speaker-Turn Detection, in which we effectively extract speaker information from conversational semantics. We also propose a simple yet effective algorithm to jointly model acoustic and semantic information and obtain speaker-identified texts. Experiments on both AISHELL-4 and AliMeeting datasets show that our method achieves consistent improvements over acoustic-only speaker diarization systems.

📄 PDF Abstract BibTeX arXiv:2305.12927

Code (0)

등록된 구현이 없습니다.

Tasks

speaker-diarizationSpeaker DiarizationSpoken Language Understanding

Similar Papers 제목 키워드 기반

Non-native Speaker Verification for Spoken Language Assessment

2019-09-30 · Lin-Lin Wang, Yu Wang, Mark J. F. Gales

Automatic spoken language assessment systems are becoming more popular in order to handle increasing interests in second language learning. One challenge for these systems is to detect malpractice. Malpractice can take a…

Speaker Verification

Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks

2024-09-16 · Eunice Akani, Benoit Favre, Frederic Bechet, Romain Gemignani

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately …

Spoken Language Understanding

Implicit spoken language diarization

2023-06-22 · Jagabandhu Mishra, Amartya Chowdhury, S. R. Mahadeva Prasanna

Spoken language diarization (LD) and related tasks are mostly explored using the phonotactic approach. Phonotactic approaches mostly use explicit way of language modeling, hence requiring intermediate phoneme modeling an…

Language ModelingLanguage Modellingspeaker-diarizationSpeaker Diarization

Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagation

2023-09-19 · Luyao Cheng, Siqi Zheng, Qinglin Zhang, Hui Wang 외

Speaker diarization has gained considerable attention within speech processing research community. Mainstream speaker diarization rely primarily on speakers' voice characteristics extracted from acoustic signals and ofte…

speaker-diarizationSpeaker DiarizationSpoken Language Understanding

Towards Modelling Coherence in Spoken Discourse

2020-12-31 · Rajaswa Patil, Yaman Kumar Singla, Rajiv Ratn Shah, Mika Hama 외

While there has been significant progress towards modelling coherence in written discourse, the work in modelling spoken discourse coherence has been quite limited. Unlike the coherence in text, coherence in spoken disco…