paper-with-me

홈 › Papers

Mega-ASR: Towards In-the-wild^2 Speech Recognition via Scaling up Real-world Acoustic Simulation

2026-05-19 · Zhifei Xie, Kaiyu Pang, Haobin Zhang, Deheng Ye, Xiaobin Hu, Shuicheng Yan, Chunyan Miao arxiv

Despite rapid advances in automatic speech recognition (ASR) and large audio-language models, robust recognition in real-world environments remains limited by an "acoustic robustness bottleneck": models often lose acoustic grounding and produce omissions or hallucinations under severe, compositional distortions. We propose Mega-ASR, a unified ASR-in-the-wild framework that combines scalable compound-data construction with progressive acoustic-to-semantic optimization. We introduce Voices-in-the-Wild-2M, covering 7 classic acoustic phenomena and 54 physically plausible compound scenarios, and train Mega-ASR with Acoustic-to-Semantic Progressive Supervised Fine-Tuning and Dual-Granularity WER-Gated Policy Optimization. Extensive experiments demonstrate that Mega-ASR achieves significant advantages over prior state-of-the-art systems on adverse-condition ASR benchmarks (45.69% vs. 54.01% on VOiCES R4-B-F, and 21.49% vs. 29.34% on NOIZEUS Sta-0). On complex compositional acoustic scenarios, Mega-ASR further delivers over 30% relative WER reduction against strong open- and closed-source baselines, establishing a scalable paradigm for robust ASR in-the-wild.

📄 PDF Abstract BibTeX arXiv:2605.19833

Code (0)

등록된 구현이 없습니다.

Tasks

Speech Recognition

Similar Papers 제목 키워드 기반

Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias

2023-06-06 · Ziyue Jiang, Yi Ren, Zhenhui Ye, Jinglin Liu 외

Scaling text-to-speech to a large and wild dataset has been proven to be highly effective in achieving timbre and speech style generalization, particularly in zero-shot TTS. However, previous works usually encode speech …

AttributeInductive BiasLanguage ModelingLanguage Modelling+4

CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training

2025-05-23 · Zhihao Du, Changfeng Gao, Yuxuan Wang, Fan Yu 외

In our prior works, we introduced a scalable streaming speech synthesis model, CosyVoice 2, which integrates a large language model (LLM) and a chunk-aware flow matching (FM) model, and achieves low-latency bi-streaming …

Automatic Speech RecognitionEmotion RecognitionEvent DetectionLanguage Identification+5

Whisper-RIR-Mega: A Paired Clean-Reverberant Speech Benchmark for ASR Robustness to Room Acoustics

2026-02-27 · Mandip Goswami arxiv

We introduce Whisper-RIR-Mega, a benchmark dataset of paired clean and reverberant speech for evaluating automatic speech recognition (ASR) robustness to room acoustics. Each sample pairs a clean LibriSpeech utterance wi…

Speech Recognition

Advancing Test-Time Adaptation in Wild Acoustic Test Settings

2023-10-14 · Hongfu Liu, Hengguan Huang, Ye Wang

Acoustic foundation models, fine-tuned for Automatic Speech Recognition (ASR), suffer from performance degradation in wild acoustic test settings when deployed in real-world scenarios. Stabilizing online Test-Time Adapta…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

SimulMEGA: MoE Routers are Advanced Policy Makers for Simultaneous Speech Translation

2025-09-01 · Chenyang Le, Bing Han, Jinshun Li, Songyong Chen 외 arxiv

Simultaneous Speech Translation (SimulST) enables real-time cross-lingual communication by jointly optimizing speech recognition and machine translation under strict latency constraints. Existing systems struggle to bala…

Machine TranslationSpeech Recognition