paper-with-me

홈 › Papers

Fine-Tuning Whisper for Automatic Speech Recognition in Baniwa: A Preliminary Study

2026-08-26 · Leonardo Duart, Tiago Fonseca, Thiago Chacón arxiv

Automatic Speech Recognition (ASR) technologies have achieved remarkable performance in recent years through the use of large multilingual foundation models. However, most advances remain concentrated on high-resource languages, while indigenous languages continue to suffer from a lack of speech resources and language technologies. This work presents a preliminary study on the adaptation of Whisper for Automatic Speech Recognition in Baniwa, an indigenous Arawakan language spoken in Brazil, Colombia, and Venezuela. The experiments were conducted using a corpus of 1,373 manually transcribed recordings obtained from a linguistic documentation project. The corpus contains approximately 0.54 hours of speech and consists primarily of isolated words and short elicited utterances. The Whisper Small model was fine-tuned using supervised learning and evaluated using Word Error Rate (WER) and Character Error Rate (CER). The best model achieved a WER of 37.5% and a CER of 7.45%, demonstrating that multilingual foundation models can be successfully adapted to extremely low-resource indigenous languages. The results establish an initial baseline for Baniwa Automatic Speech Recognition and provide a foundation for future research involving larger datasets, language-specific adaptation strategies, and post-processing techniques.

📄 PDF Abstract BibTeX arXiv:2608.26060

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Recognition

Similar Papers 제목 키워드 기반

PhoWhisper: Automatic Speech Recognition for Vietnamese

2024-03-27 · Thanh-Thien Le, Linh The Nguyen, Dat Quoc Nguyen

We introduce PhoWhisper in five versions for Vietnamese automatic speech recognition. PhoWhisper's robustness is achieved through fine-tuning the Whisper model on an 844-hour dataset that encompasses diverse Vietnamese a…

Automatic Speech Recognitionspeech-recognitionSpeech Recognition

Adaptation of Whisper models to child speech recognition

2023-07-24 · Rishabh Jain, Andrei Barcovschi, Mariam Yiwere, Peter Corcoran 외

Automatic Speech Recognition (ASR) systems often struggle with transcribing child speech due to the lack of large child speech datasets required to accurately train child-friendly ASR models. However, there are huge amou…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

A Speech Corpus for Mizo Automatic Speech Recognition: Whisper and SraVaani 1.0 Fine-Tuning with Morphology-Aware Evaluation

2026-08-19 · Priyankoo Sarmah, Sanasam Ranbir Singh, Lalhmingmawia arxiv

This study reports the development of an Automatic Speech Recognition (ASR) system in Mizo, a low-resource language. The development included collecting 17.62 hours of speech data, curating it, and fine-tuning the Mizo A…

Speech Recognition

Whispering in Amharic: Fine-tuning Whisper for Low-resource Language

2025-03-24 · Dawit Ketema Gete, Bedru Yimam Ahmed, Tadesse Destaw Belay, Yohannes Ayana Ejigu 외

This work explores fine-tuning OpenAI's Whisper automatic speech recognition (ASR) model for Amharic, a low-resource language, to improve transcription accuracy. While the foundational Whisper model struggles with Amhari…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

WhisperNER: Unified Open Named Entity and Speech Recognition

2024-09-12 · Gil Ayache, Menachem Pirchi, Aviv Navon, Aviv Shamsian 외

Integrating named entity recognition (NER) with automatic speech recognition (ASR) can significantly enhance transcription accuracy and informativeness. In this paper, we introduce WhisperNER, a novel model that allows j…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Informativenessnamed-entity-recognition+5