paper-with-me

홈 › Papers

Efficient Data Selection for Domain Adaptation of ASR Using Pseudo-Labels and Multi-Stage Filtering

2025-06-04 · Pradeep Rangappa, Andres Carofilis, Jeena Prakash, Shashi Kumar, Sergio Burdisso, Srikanth Madikeri, Esau Villatoro-Tello, Bidisha Sharma, Petr Motlicek, Kadri Hacioglu, Shankar Venkatesan, Saurabh Vyas, Andreas Stolcke

Fine-tuning pretrained ASR models for specific domains is challenging for small organizations with limited labeled data and computational resources. Here, we explore different data selection pipelines and propose a robust approach that improves ASR adaptation by filtering pseudo-labels generated using Whisper (encoder-decoder) and Zipformer (transducer) models. Our approach integrates multiple selection strategies -- including word error rate (WER) prediction, named entity recognition (NER), and character error rate (CER) analysis -- to extract high-quality training segments. We evaluate our method on Whisper and Zipformer using a 7500-hour baseline, comparing it to a CER-based approach relying on hypotheses from three ASR systems. Fine-tuning on 7500 hours of pseudo-labeled call center data achieves 12.3% WER, while our filtering reduces the dataset to 100 hours (1.4%) with similar performance; a similar trend is observed on Fisher English.

📄 PDF Abstract BibTeX arXiv:2506.03681

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDomain Adaptationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Similar Papers 제목 키워드 기반

Domain-Specific Block Selection and Paired-View Pseudo-Labeling for Online Test-Time Adaptation

2024-04-17 · CVPR 2024 1 · Yeonguk Yu, Sungho Shin, Seunghyeok Back, Minhwan Ko 외

Test-time adaptation (TTA) aims to adapt a pre-trained model to a new test domain without access to source data after deployment. Existing approaches typically rely on self-training with pseudo-labels since ground-truth …

Pseudo LabelTest-time Adaptation

CA-UDA: Class-Aware Unsupervised Domain Adaptation with Optimal Assignment and Pseudo-Label Refinement

2022-05-26 · Can Zhang, Gim Hee Lee

Recent works on unsupervised domain adaptation (UDA) focus on the selection of good pseudo-labels as surrogates for the missing labels in the target data. However, source domain bias that deteriorates the pseudo-labels c…

Domain Adaptationimage-classificationImage ClassificationMissing Labels+2

Loss-based Sequential Learning for Active Domain Adaptation

2022-04-25 · Kyeongtak Han, Youngeun Kim, Dongyoon Han, Sungeun Hong

Active domain adaptation (ADA) studies have mainly addressed query selection while following existing domain adaptation strategies. However, we argue that it is critical to consider not only query selection criteria but …

DiversityDomain Adaptation

Less is More: Pseudo-Label Filtering for Continual Test-Time Adaptation

2024-06-03 · Jiayao Tan, Fan Lyu, Chenggong Ni, Tingliang Feng 외

Continual Test-Time Adaptation (CTTA) aims to adapt a pre-trained model to a sequence of target domains during the test phase without accessing the source data. To adapt to unlabeled data from unknown domains, existing m…

DiversityPseudo LabelPseudo Label FilteringTest-time Adaptation

SRPL-SFDA: SAM-Guided Reliable Pseudo-Labels for Source-Free Domain Adaptation in Medical Image Segmentation

2025-06-11 · Xinya Liu, Jianghao Wu, Tao Lu, Shaoting Zhang 외

Domain Adaptation (DA) is crucial for robust deployment of medical image segmentation models when applied to new clinical centers with significant domain shifts. Source-Free Domain Adaptation (SFDA) is appealing as it ca…

Domain AdaptationImage SegmentationMedical Image SegmentationPseudo Label+2