Towards Multi-Level Transcript Segmentation: LoRA Fine-Tuning for Table-of-Contents Generation
Segmenting speech transcripts into thematic sections benefits both downstream processing and users who depend on written text for accessibility. We introduce a novel approach to hierarchical topic segmentation in transcripts, generating multi-level tables of contents that capture both topic and subtopic boundaries. We compare zero-shot prompting and LoRA fine-tuning on large language models, while also exploring the integration of high-level speech pause features. Evaluations on English meeting recordings and multilingual lecture transcripts (Portuguese, German) show significant improvements over established topic segmentation baselines. Additionally, we adapt a common evaluation measure for multi-level segmentation, taking into account all hierarchical levels within one metric.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CrisperWhisper: Accurate Timestamps on Verbatim Speech Transcriptions
We demonstrate that carefully adjusting the tokenizer of the Whisper speech recognition model significantly improves the precision of word-level timestamps when applying dynamic time warping to the decoder's cross-attent…
Dynamic Time Warpingspeech-recognitionSpeech RecognitionEnhancing Aviation Communication Transcription: Fine-Tuning Distil-Whisper with LoRA
Transcription of aviation communications has several applications, from assisting air traffic controllers in identifying the accuracy of read-back errors to search and rescue operations. Recent advances in artificial int…
Automatic Speech Recognitionparameter-efficient fine-tuningspeech-recognitionSpeech RecognitionConvolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Model
The Segment Anything Model (SAM) stands as a foundational framework for image segmentation. While it exhibits remarkable zero-shot generalization in typical scenarios, its advantage diminishes when applied to specialized…
Image Segmentationparameter-efficient fine-tuningSegmentationSemantic Segmentation+1Robust Singing Voice Transcription Serves Synthesis
Note-level Automatic Singing Voice Transcription (AST) converts singing recordings into note sequences, facilitating the automatic annotation of singing datasets for Singing Voice Synthesis (SVS) applications. Current AS…
DecoderSinging Voice SynthesisD3RM: A Discrete Denoising Diffusion Refinement Model for Piano Transcription
Diffusion models have been widely used in the generative domain due to their convincing performance in modeling complex data distributions. Moreover, they have shown competitive results on discriminative tasks, such as i…
DenoisingImage SegmentationMusic TranscriptionSemantic Segmentation