paper-with-me

Papers

Speech Denoising Without Clean Training Data: A Noise2Noise Approach

2021-04-08 · Madhav Mahesh Kashyap, Anuj Tambwekar, Krishnamoorthy Manohara, S Natarajan

This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples. Conventional wisdom dictates that in order to achieve good speech denoising performance, there is a requirement for a large quantity of both noisy speech samples and perfectly clean speech samples, resulting in a need for expensive audio recording equipment and extremely controlled soundproof recording studios. These requirements pose significant challenges in data collection, especially in economically disadvantaged regions and for low resource languages. This work shows that speech denoising deep neural networks can be successfully trained utilizing only noisy training audio. Furthermore it is revealed that such training regimes achieve superior denoising performance over conventional training regimes utilizing clean training audio targets, in cases involving complex noise distributions and low Signal-to-Noise ratios (high noise environments). This is demonstrated through experiments studying the efficacy of our proposed approach over both real-world noises and synthetic noises using the 20 layered Deep Complex U-Net architecture.

📄 PDF Abstract BibTeX arXiv:2104.03838

Code (2)

madhavmk/Noise2Noise-audio_denoising_without_clean_training_data 공식 구현 pytorch
khalida1wwin/Noise2Noise-audio_denoising_without_clean_training_data pytorch

Tasks

Audio DenoisingDenoisingSelf-Supervised LearningSpeech DenoisingSpeech Enhancement

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Self-Supervised Speech Denoising Using Only Noisy Audio Signals

2021-10-30 · Jiasong Wu, Qingchun Li, Guanyu Yang, Lei LI 외

In traditional speech denoising tasks, clean audio signals are often used as the training target, but absolutely clean signals are collected from expensive recording equipment or in studios with the strict environments. …

Audio DenoisingDenoisingSpeech Denoising

CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning

2024-10-14 · Sjoerd Groot, Qinyu Chen, Jan C. van Gemert, Chang Gao

This paper presents CleanUMamba, a time-domain neural network architecture designed for real-time causal audio denoising directly applied to raw waveforms. CleanUMamba leverages a U-Net encoder-decoder structure, incorpo…

Audio DenoisingDecoderDenoisingMamba+1

Continuous Modeling of the Denoising Process for Speech Enhancement Based on Deep Learning

2023-09-17 · Zilu Guo, Jun Du, Chin-Hui Lee

In this paper, we explore a continuous modeling approach for deep-learning-based speech enhancement, focusing on the denoising process. We use a state variable to indicate the denoising process. The starting state is noi…

Automatic Speech RecognitionDenoisingSpeech Enhancementspeech-recognition+1

CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram

2023-09-12 · Zhifeng Kong, Wei Ping, Ambrish Dantrey, Bryan Catanzaro

In this work, we present CleanUNet 2, a speech denoising model that combines the advantages of waveform denoiser and spectrogram denoiser and achieves the best of both worlds. CleanUNet 2 uses a two-stage framework inspi…

DenoisingSpeech DenoisingSpeech EnhancementSpeech Synthesis

Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement

2022-10-27 · Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka 외

Although deep neural network (DNN)-based speech enhancement (SE) methods outperform the previous non-DNN-based ones, they often degrade the perceptual quality of generated outputs. To tackle this problem, we introduce a …

DenoisingSpeech Enhancement