MultiTurnCleanup: A Benchmark for Multi-Turn Spoken Conversational Transcript Cleanup
Current disfluency detection models focus on individual utterances each from a single speaker. However, numerous discontinuity phenomena in spoken conversational transcripts occur across multiple turns, hampering human readability and the performance of downstream NLP tasks. This study addresses these phenomena by proposing an innovative Multi-Turn Cleanup task for spoken conversational transcripts and collecting a new dataset, MultiTurnCleanup1. We design a data labeling schema to collect the high-quality dataset and provide extensive data analysis. Furthermore, we leverage two modeling approaches for experimental evaluation as benchmarks for future research.
Code (1)
Similar Papers 제목 키워드 기반
What BERT Based Language Models Learn in Spoken Transcripts: An Empirical Study
Language Models (LMs) have been ubiquitously leveraged in various tasks including spoken language understanding (SLU). Spoken language requires careful understanding of speaker interactions, dialog states and speech indu…
Spoken Language UnderstandingWhat BERT Based Language Model Learns in Spoken Transcripts: An Empirical Study
Language Models (LMs) have been ubiquitously leveraged in various tasks including spoken language understanding (SLU). Spoken language requires careful understanding of speaker interactions, dialog states and speech indu…
Language ModelingLanguage ModellingSpoken Language UnderstandingData-Centric Improvements for Enhancing Multi-Modal Understanding in Spoken Conversation Modeling
Conversational assistants are increasingly popular across diverse real-world applications, highlighting the need for advanced multimodal speech modeling. Speech, as a natural mode of communication, encodes rich user-spec…
Multi-Task LearningBuilding a Taiwanese Mandarin Spoken Language Model: A First Attempt
This technical report presents our initial attempt to build a spoken large language model (LLM) for Taiwanese Mandarin, specifically tailored to enable real-time, speech-to-speech interaction in multi-turn conversations.…
DecoderLanguage ModelingLanguage ModellingLarge Language ModelTalking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
The recent wave of audio foundation models (FMs) could provide new capabilities for conversational modeling. However, there have been limited efforts to evaluate these audio FMs comprehensively on their ability to have n…
BenchmarkingSpoken Dialogue Systems