paper-with-me

홈 › Papers

Phase-aware Single-stage Speech Denoising and Dereverberation with U-Net

2020-06-01 · Interspeech 2020 6

In this work, we tackle a denoising and dereverberation problem with a single-stage framework. Although denoising and dereverberation may be considered two separate challenging tasks, and thus, two modules are typically required for each task, we show that a single deep network can be shared to solve the two problems. To this end, we propose a new masking method called phase-aware beta-sigmoid mask (PHM), which reuses the estimated magnitude values to estimate the clean phase by respecting the triangle inequality in the complex domain between three signal components such as mixture, source and the rest. Two PHMs are used to deal with direct and reverberant source, which allows controlling the proportion of reverberation in the enhanced speech at inference time. In addition, to improve the speech enhancement performance, we propose a new time-domain loss function and show a reasonable performance gain compared to MSE loss in the complex domain. Finally, to achieve a real-time inference, an optimization strategy for U-Net is proposed which significantly reduces the computational overhead up to 88.9% compared to the na\"ive version.

📄 PDF Abstract BibTeX arXiv:2006.00687

Code (1)

jonashaag/paperswithcode-speech-enhancement-audiosamples/tree/master/Phase-aware%20Single-stage%20Speech%20Denoising%20and%20Dereverberation%20with%20U-Net

Tasks

DenoisingSpeech DenoisingSpeech Enhancement

Similar Papers 제목 키워드 기반

Stage-Wise and Prior-Aware Neural Speech Phase Prediction

2024-10-07 · Fei Liu, Yang Ai, Hui-Peng Du, Ye-Xin Lu 외

This paper proposes a novel Stage-wise and Prior-aware Neural Speech Phase Prediction (SP-NSPP) model, which predicts the phase spectrum from input amplitude spectrum by two-stage neural networks. In the initial prior-co…

Prediction

Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusion

2024-06-05 · CVPR 2025 1 · Hao Wen, Zehuan Huang, Yaohui Wang, Xinyuan Chen 외

Existing single image-to-3D creation methods typically involve a two-stage process, first generating multi-view images, and then using these images for 3D reconstruction. However, training these two stages separately lea…

3D Generation3D ReconstructionDenoisingImage Generation+1

A Neural Denoising Vocoder for Clean Waveform Generation from Noisy Mel-Spectrogram based on Amplitude and Phase Predictions

2024-11-19 · Hui-Peng Du, Ye-Xin Lu, Yang Ai, Zhen-Hua Ling

This paper proposes a novel neural denoising vocoder that can generate clean speech waveforms from noisy mel-spectrograms. The proposed neural denoising vocoder consists of two components, i.e., a spectrum predictor and …

DenoisingSpeech Enhancement

A Two-Stage Framework in Cross-Spectrum Domain for Real-Time Speech Enhancement

2024-01-19 · Yuewei Zhang, Huanbin Zou, Jie Zhu

Two-stage pipeline is popular in speech enhancement tasks due to its superiority over traditional single-stage methods. The current two-stage approaches usually enhance the magnitude spectrum in the first stage, and furt…

Speech Enhancement

A Two-stage Complex Network using Cycle-consistent Generative Adversarial Networks for Speech Enhancement

2021-09-05 · Guochen Yu, Yutian Wang, Hui Wang, Qin Zhang 외

Cycle-consistent generative adversarial networks (CycleGAN) have shown their promising performance for speech enhancement (SE), while one intractable shortcoming of these CycleGAN-based SE systems is that the noise compo…

DenoisingSpeech Enhancement