paper-with-me

Papers

Metric-oriented Speech Enhancement using Diffusion Probabilistic Model

2023-02-23 · Chen Chen, Yuchen Hu, Weiwei Weng, Eng Siong Chng

Deep neural network based speech enhancement technique focuses on learning a noisy-to-clean transformation supervised by paired training data. However, the task-specific evaluation metric (e.g., PESQ) is usually non-differentiable and can not be directly constructed in the training criteria. This mismatch between the training objective and evaluation metric likely results in sub-optimal performance. To alleviate it, we propose a metric-oriented speech enhancement method (MOSE), which leverages the recent advances in the diffusion probabilistic model and integrates a metric-oriented training strategy into its reverse process. Specifically, we design an actor-critic based framework that considers the evaluation metric as a posterior reward, thus guiding the reverse process to the metric-increasing direction. The experimental results demonstrate that MOSE obviously benefits from metric-oriented training and surpasses the generative baselines in terms of all evaluation metrics.

📄 PDF Abstract BibTeX arXiv:2302.11989

Code (0)

등록된 구현이 없습니다.

Tasks

modelSpeech Enhancement

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Conditional Diffusion Probabilistic Model for Speech Enhancement

2022-02-10 · Yen-Ju Lu, Zhong-Qiu Wang, Shinji Watanabe, Alexander Richard 외

Speech enhancement is a critical component of many user-oriented audio applications, yet current systems still suffer from distorted and unnatural outputs. While generative models have shown strong potential in speech sy…

modelSpeech EnhancementSpeech Synthesis

DiffPhase: Generative Diffusion-based STFT Phase Retrieval

2022-11-08 · Tal Peer, Simon Welker, Timo Gerkmann

Diffusion probabilistic models have been recently used in a variety of tasks, including speech enhancement and synthesis. As a generative approach, diffusion models have been shown to be especially suitable for imputatio…

ImputationRetrievalSpeech Enhancement

A Study on Speech Enhancement Based on Diffusion Probabilistic Model

2021-07-25 · Yen-Ju Lu, Yu Tsao, Shinji Watanabe

Diffusion probabilistic models have demonstrated an outstanding capability to model natural images and raw audio waveforms through a paired diffusion and reverse processes. The unique property of the reverse process (nam…

Speech Enhancement

SE-Bridge: Speech Enhancement with Consistent Brownian Bridge

2023-05-23 · Zhibin Qiu, Mengfan Fu, Fuchun Sun, Gulila Altenbek 외

We propose SE-Bridge, a novel method for speech enhancement (SE). After recently applying the diffusion models to speech enhancement, we can achieve speech enhancement by solving a stochastic differential equation (SDE).…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speaker VerificationSpeech Enhancement+2

Noise-aware Speech Enhancement using Diffusion Probabilistic Model

2023-07-16 · Yuchen Hu, Chen Chen, Ruizhe Li, Qiushi Zhu 외

With recent advances of diffusion model, generative speech enhancement (SE) has attracted a surge of research interest due to its great potential for unseen testing noises. However, existing efforts mainly focus on inher…

DenoisingmodelMulti-Task LearningSpecificity+1