Wind Noise Reduction with a Diffusion-based Stochastic Regeneration Model
In this paper we present a method for single-channel wind noise reduction using our previously proposed diffusion-based stochastic regeneration model combining predictive and generative modelling. We introduce a non-additive speech in noise model to account for the non-linear deformation of the membrane caused by the wind flow and possible clipping. We show that our stochastic regeneration model outperforms other neural-network-based wind noise reduction methods as well as purely predictive and generative models, on a dataset using simulated and real-recorded wind noise. We further show that the proposed method generalizes well by testing on an unseen dataset with real-recorded wind noise. Audio samples, data generation scripts and code for the proposed methods can be found online (https://uhh.de/inf-sp-storm-wind).
Code (1)
Similar Papers 제목 키워드 기반
SCoRe: Clean Image Generation from Diffusion Models Trained on Noisy Images
Diffusion models trained on noisy datasets often reproduce high-frequency training artifacts, significantly degrading generation quality. To address this, we propose SCoRe (Spectral Cutoff Regeneration), a training-free,…
Image GenerationFADI-AEC: Fast Score Based Diffusion Model Guided by Far-end Signal for Acoustic Echo Cancellation
Despite the potential of diffusion models in speech enhancement, their deployment in Acoustic Echo Cancellation (AEC) has been restricted. In this paper, we propose DI-AEC, pioneering a diffusion-based stochastic regener…
Acoustic echo cancellationSpeech EnhancementDiscontinuous Jump Behavior of the Energy Conversion in Wind Energy Systems
The power conversion process of a wind turbine can be characterized by a stochastic differential equation (SDE) of the power output conditioned to certain fixed wind speeds. An analogous approach can also be applied to t…
StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberation
Diffusion models have shown a great ability at bridging the performance gap between predictive and generative approaches for speech enhancement. We have shown that they may even outperform their predictive counterparts f…
Speech DereverberationSpeech EnhancementDeWinder: Single-Channel Wind Noise Reduction using Ultrasound Sensing
The quality of audio recordings in outdoor environments is often degraded by the presence of wind. Mitigating the impact of wind noise on the perceptual quality of single-channel speech remains a significant challenge du…
Speech Enhancement