paper-with-me

홈 › Papers

FullSubNet+: Channel Attention FullSubNet with Complex Spectrograms for Speech Enhancement

2022-03-23 · Jun Chen, Zilin Wang, Deyi Tuo, Zhiyong Wu, Shiyin Kang, Helen Meng

Previously proposed FullSubNet has achieved outstanding performance in Deep Noise Suppression (DNS) Challenge and attracted much attention. However, it still encounters issues such as input-output mismatch and coarse processing for frequency bands. In this paper, we propose an extended single-channel real-time speech enhancement framework called FullSubNet+ with following significant improvements. First, we design a lightweight multi-scale time sensitive channel attention (MulCA) module which adopts multi-scale convolution and channel attention mechanism to help the network focus on more discriminative frequency bands for noise reduction. Then, to make full use of the phase information in noisy speech, our model takes all the magnitude, real and imaginary spectrograms as inputs. Moreover, by replacing the long short-term memory (LSTM) layers in original full-band model with stacked temporal convolutional network (TCN) blocks, we design a more efficient full-band module called full-band extractor. The experimental results in DNS Challenge dataset show the superior performance of our FullSubNet+, which reaches the state-of-the-art (SOTA) performance and outperforms other existing speech enhancement approaches.

📄 PDF Abstract BibTeX arXiv:2203.12188

Code (2)

thuhcsi/fullsubnet-plus 공식 구현 pytorch
hit-thusz-rookiecj/fullsubnet-plus pytorch

Tasks

Speech Enhancement

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Fast FullSubNet: Accelerate Full-band and Sub-band Fusion Model for Single-channel Speech Enhancement

2022-12-18 · Xiang Hao, Xiaofei Li

FullSubNet is our recently proposed real-time single-channel speech enhancement network that achieves outstanding performance on the Deep Noise Suppression (DNS) Challenge dataset. A number of variants of FullSubNet have…

Computational EfficiencySpeech Enhancement

FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement

2020-10-29 · Xiang Hao, Xiangdong Su, Radu Horaud, Xiaofei Li

This paper proposes a full-band and sub-band fusion model, named as FullSubNet, for single-channel real-time speech enhancement. Full-band and sub-band refer to the models that input full-band and sub-band noisy spectral…

Speech Enhancement

Mel-FullSubNet: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR

2024-02-21 · Rui Zhou, Xian Li, Ying Fang, Xiaofei Li

In this work, we propose Mel-FullSubNet, a single-channel Mel-spectrogram denoising and dereverberation network for improving both speech quality and automatic speech recognition (ASR) performance. Mel-FullSubNet takes a…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DenoisingSpeech Enhancement+2

Towards Ultra-Low-Power Neuromorphic Speech Enhancement with Spiking-FullSubNet

2024-10-07 · Xiang Hao, Chenxiang Ma, Qu Yang, Jibin Wu 외

Speech enhancement is critical for improving speech intelligibility and quality in various audio devices. In recent years, deep learning-based methods have significantly improved speech enhancement performance, but they …

DenoisingSpeech DenoisingSpeech Enhancement

Speech Enhancement for Virtual Meetings on Cellular Networks

2023-02-02 · Hojeong Lee, Minseon Gwak, Kawon Lee, Minjeong Kim 외

We study speech enhancement using deep learning (DL) for virtual meetings on cellular devices, where transmitted speech has background noise and transmission loss that affects speech quality. Since the Deep Noise Suppres…

Deep LearningSpeech Enhancement