paper-with-me

홈 › Papers

From Self-Supervised Speech Models to Mixture-of-Experts for Robust Anti-Spoofing

2026-06-12 · Hugo Daumain, Driss Matrouf, Khaled Khelif, Mickael Rouvier arxiv

Recent advances in speech generation have significantly improved the naturalness of synthetic speech, making spoofing detection increasingly challenging. A key limitation of current anti-spoofing systems is their limited robustness to unseen synthesis methods. In this work, we transform a self-supervised speech representation model into a Mixture-of-Experts (MoE) architecture to improve generalization. Feed-forward blocks in selected encoder layers are replaced by multiple expert networks controlled by a layer-wise gating mechanism, allowing experts to capture complementary acoustic patterns while preserving the representations learned during self-supervised pretraining. We further analyze the architectural choices affecting the performance of this MoE conversion and investigate the activation behavior of the experts. The proposed approach is evaluated on 14 spoofing datasets and reduces the macro EER from 5.46% to 4.81%, corresponding to 11.9% relative improvement over the baseline.

📄 PDF Abstract BibTeX arXiv:2606.14639

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Lamer-SSL: Layer-aware Mixture of LoRA Experts for Continual Multilingual Expansion of Self-supervised Models without Forgetting

2026-02-13 · Jing Xu, Minglin Wu, Xueyuan Chen, Xixin Wu 외 arxiv

Despite their impressive performance, self-supervised speech models often struggle to generalize to new languages and tend to forget previously acquired knowledge during continual training. To address this, we propose La…

Language IdentificationSpeech Recognition

Speech Quality Assessment Model Based on Mixture of Experts: System-Level Performance Enhancement and Utterance-Level Challenge Analysis

2025-07-08 · Xintong Hu, Yixuan Chen, Rui Yang, Wenxiang Guo 외

Automatic speech quality assessment plays a crucial role in the development of speech synthesis systems, but existing models exhibit significant performance variations across different granularity levels of prediction ta…

Data AugmentationMixture-of-ExpertsPredictionSelf-Supervised Learning+5

Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach

2026-06-19 · Tzu-Chieh Wei, Yi-Cheng Lin, Huang-Cheng Chou, Kuan-Yu Chen 외 arxiv

As expressive text-to-speech (TTS) and voice conversion (VC) systems increasingly generate non-verbal vocalizations (NVVs) to enhance naturalness, reliable speaker verification (SV) becomes essential to objectively asses…

Speaker VerificationVoice Conversion

Aphasic Speech Recognition using a Mixture of Speech Intelligibility Experts

2020-08-25

Robust speech recognition is a key prerequisite for semantic feature extraction in automatic aphasic speech analysis. However, standard one-size-fits-all automatic speech recognition models perform poorly when applied to…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Mixture-of-ExpertsRobust Speech Recognition+2

Beyond Hard Sharing: Efficient Multi-Task Speech-to-Text Modeling with Supervised Mixture of Experts

2025-08-05 · Hojun Jin, Eunsoo Hong, Ziwon Hyung, Sungjun Lim 외 arxiv

Hard-parameter sharing is a common strategy to train a single model jointly across diverse tasks. However, this often leads to task interference, impeding overall model performance. To address the issue, we propose a sim…

Speech Recognition