Transformer-based segmentation of prosodic boundaries in Brazilian Portuguese
Automatic prosodic segmentation identifies boundaries between speech units from acoustic and linguistic evidence. Although recent deep learning approaches have produced strong results for English, automatic segmentation for Brazilian Portuguese (BP) still relies mostly on rule-based or traditional machine-learning methods. This paper presents SAMPA, a Whisper-based segmenter that transcribes BP speech while inserting explicit markers for terminal prosodic boundaries. We fine-tune Whisper large-v3 on manually segmented recordings from the NURC-SP dataset and evaluate different training and test-time filtering configurations, including out-of-distribution testing on the MuPe-Diversidades dataset. SAMPA achieves competitive boundary-detection performance across settings, with the best models reaching F1=0.731 on the held-out test split and F1=0.796 on MuPe-Diversidades. Finally, through n-gram and acoustic-visual analyses, we show that our model follows morphosyntactic, semantic, and prosodic cues for detecting prosodic boundaries.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Brazilian Portuguese Phonological-prosodic Algorithm Applied to Language Acquisition: A Case Study
The C-ORAL-BRASIL I: Reference Corpus for Spoken Brazilian Portuguese
C-ORAL-BRASIL I is a Brazilian Portuguese spontaneous speech corpus compiled following the same architecture adopted by the C-ORAL-ROM resource. The main goal is the documentation of the diaphasic and diastratic variatio…
text-to-speechText to SpeechThe Impact of Prosodic Segmentation on Speech Synthesis of Spontaneous Speech
Spontaneous speech presents several challenges for speech synthesis, particularly in capturing the natural flow of conversation, including turn-taking, pauses, and disfluencies. Although speech synthesis systems have mad…
Speech SynthesisIntroducing the SEA\_AP: an Enhanced Tool for Automatic Prosodic Analysis
SEA{\_}AP (Segmentador e Etiquetador Autom{\'a}tico para An{\'a}lise Pros{\'o}dica, Automatic Segmentation and Labelling for Prosodic Analysis) toolkit is an application that performs audio segmentation and labelling to …
SegmentationImage captioning for Brazilian Portuguese using GRIT model
This work presents the early development of a model of image captioning for the Brazilian Portuguese language. We used the GRIT (Grid - and Region-based Image captioning Transformer) model to accomplish this work. GRIT i…
Image Captioningmodel