paper-with-me

Papers

MEDIBENG WHISPER TINY: A FINE-TUNED CODE-SWITCHED BENGALI-ENGLISH TRANSLATOR FOR CLINICAL APPLICATIONS

2025-04-25 · medRxiv 2025 4 · Promila Ghosh, Sunipun Talukder

Code-switching in multilingual healthcare settings challenges automated transcription systems as facilities adopt AI documentation tools. To tackle this issue, we developed a cost-effective solution using the MediBeng Whisper Tiny model, a fine-tuned version of the Whisper Tiny model specifically designed for code-switched Bengali-English conversations in healthcare contexts. The model was fine-tuned on MediBeng, a synthetic dataset created to simulate the types of bilingual interactions often found in healthcare environments. The fine-tuning process involved using just 20% of the dataset, making it highly efficient in terms of computational resources and data usage. Despite the limited data, our model achieved an exceptional 0.01 Word Error Rate (WER), reflecting near-perfect transcription accuracy. Additionally, the model attained a 0.98 BLEU score, indicating its ability to accurately translate mixed-language input into English. These impressive results demonstrate that even with minimal data and resources, the model can handle complex code-switching tasks effectively. This model improves information processing for healthcare professionals, allowing doctors to save time on paperwork and focus more on patient care. It also ensures patient records are more accurate and accessible, aiding better healthcare decision-making.

📄 PDF Abstract BibTeX

Code (1)

pr0mila/MediBeng-Whisper-Tiny pytorch

Tasks

Clinical Language TranslationMachine TranslationSpeech-to-TextSpeech-to-Text TranslationSynthetic Data Generation

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Focus 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Efficient Adaptation of Multilingual Models for Japanese ASR

2024-12-14 · Mark Bajo, Haruka Fukukawa, Ryuji Morita, Yuma Ogasawara

This study explores fine-tuning multilingual ASR (Automatic Speech Recognition) models, specifically OpenAI's Whisper-Tiny, to improve performance in Japanese. While multilingual models like Whisper offer versatility, th…

Automatic Speech Recognitionspeech-recognitionSpeech Recognition

Adopting Whisper for Confidence Estimation

2025-02-19 · Vaibhav Aggarwal, Shabari S Nair, Yash Verma, Yash Jogi

Recent research on word-level confidence estimation for speech recognition systems has primarily focused on lightweight models known as Confidence Estimation Modules (CEMs), which rely on hand-engineered features derived…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Using fine-tuning and min lookahead beam search to improve Whisper

2023-09-19 · Andrea Do, Oscar Brown, Zhengjie Wang, Nikhil Mathew 외

The performance of Whisper in low-resource languages is still far from perfect. In addition to a lack of training data on low-resource languages, we identify some limitations in the beam search algorithm used in Whisper.…

Assessing the Feasibility of Lightweight Whisper Models for Low-Resource Urdu Transcription

2025-08-13 · Abdul Rehman Antall, Naveed Akhtar arxiv

This study evaluates the feasibility of lightweight Whisper models (Tiny, Base, Small) for Urdu speech recognition in low-resource settings. Despite Urdu being the 10th most spoken language globally with over 230 million…

Speech Recognition

Deepfake Word Detection by Next-token Prediction using Fine-tuned Whisper

2026-02-26 · Hoan My Tran, Xin Wang, Wanying Ge, Xuechen Liu 외 arxiv

Deepfake speech utterances can be forged by replacing one or more words in a bona fide utterance with semantically different words synthesized with speech-generative models. While a dedicated synthetic word detector coul…