Metric-oriented Speech Enhancement using Diffusion Probabilistic Model
Deep neural network based speech enhancement technique focuses on learning a noisy-to-clean transformation supervised by paired training data. However, the task-specific evaluation metric (e.g., PESQ) is usually non-differentiable and can not be directly constructed in the training criteria. This mismatch between the training objective and evaluation metric likely results in sub-optimal performance. To alleviate it, we propose a metric-oriented speech enhancement method (MOSE), which leverages the recent advances in the diffusion probabilistic model and integrates a metric-oriented training strategy into its reverse process. Specifically, we design an actor-critic based framework that considers the evaluation metric as a posterior reward, thus guiding the reverse process to the metric-increasing direction. The experimental results demonstrate that MOSE obviously benefits from metric-oriented training and surpasses the generative baselines in terms of all evaluation metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
modelSpeech EnhancementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Conditional Diffusion Probabilistic Model for Speech Enhancement
Speech enhancement is a critical component of many user-oriented audio applications, yet current systems still suffer from distorted and unnatural outputs. While generative models have shown strong potential in speech sy…
modelSpeech EnhancementSpeech SynthesisDiffPhase: Generative Diffusion-based STFT Phase Retrieval
Diffusion probabilistic models have been recently used in a variety of tasks, including speech enhancement and synthesis. As a generative approach, diffusion models have been shown to be especially suitable for imputatio…
ImputationRetrievalSpeech EnhancementA Study on Speech Enhancement Based on Diffusion Probabilistic Model
Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (nam…
Speech EnhancementSE-Bridge: Speech Enhancement with Consistent Brownian Bridge
We propose SE-Bridge, a novel method for speech enhancement (SE). After recently applying the diffusion models to speech enhancement, we can achieve speech enhancement by solving a stochastic differential equation (SDE).…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speaker VerificationSpeech Enhancement+2Noise-aware Speech Enhancement using Diffusion Probabilistic Model
With recent advances of diffusion model, generative speech enhancement (SE) has attracted a surge of research interest due to its great potential for unseen testing noises. However, existing efforts mainly focus on inher…
DenoisingmodelMulti-Task LearningSpecificity+1